What Are The Conditions For Effective Teachers In Knowledge Distillation?
What Are The Conditions For Effective Teachers In Knowledge Distillation?
Knowledge Distillation
Multimodal End-to-end Transformer
Multimodal End-to-end Transformer
Transformer
Backdoor Attack On Self-supervised Learning
Backdoor Attack On Self-supervised Learning
Backdoor Attack
Revisiting Weakly Supervised Pre-training In Visual Recognition Models
Revisiting Weakly Supervised Pre-training In Visual Recognition Models
Image Recognition
Should The Kernel Size For CNN Be Larger?
Should The Kernel Size For CNN Be Larger?
Article
How Does Pruning Of The ImageNet Pre-training Model Work In Downstream Tasks?
How Does Pruning Of The ImageNet Pre-training Model Work In Downstream Tasks?
Pruning
What Are The Data Set Requirements For Successful Self-supervised Controlled Learning?
What Are The Data Set Requirements For Successful Self-supervised Controlled Learning?
Dataset
Affine Parameters In Batch Normalization Can Be Detrimental In Few-Shot Learning!
Affine Parameters In Batch Normalization Can Be Detrimental In Few-Shot Learning!
Few-Shot
Small Neural Networks Should Augmentation The Network!
Small Neural Networks Should Augmentation The Network!
Regularization
Pre-training Of Language Models Is Possible Even With HTML Data!
Pre-training Of Language Models Is Possible Even With HTML Data!
Natural Language Processing
EXT5: Extreme Multitasking Scaling For Transition Learning
EXT5: Extreme Multitasking Scaling For Transition Learning
Natural Language Processing
Test Accuracy Can Be Inferred From GAN Samples!
Test Accuracy Can Be Inferred From GAN Samples!
GAN (Hostile Generation Network)
Fine-Tuning To Enhance Zero-Shot Performance Of Language Models
Fine-Tuning To Enhance Zero-Shot Performance Of Language Models
Zero Shot
Comparing Prior Learning Language Models In Continuous Learning
Comparing Prior Learning Language Models In Continuous Learning
Continual Learning
Are Cost Indicators Necessarily Appropriate?
Are Cost Indicators Necessarily Appropriate?
Article
Effects Of Model And Prior Learning Scale On Catastrophic Forgetting
Effects Of Model And Prior Learning Scale On Catastrophic Forgetting
Continual Learning
When, Why, And Which Pretrained GANs Are Useful?
When, Why, And Which Pretrained GANs Are Useful?
GAN (Hostile Generation Network)
Can Language Models Be Grounded In Non-verbal Conceptual Space?
Can Language Models Be Grounded In Non-verbal Conceptual Space?
Article