A Better Attention Mechanism Will Improve The Performance Of LLM's Long-text Processing!
A Better Attention Mechanism Will Improve The Performance Of LLM's Long-text Processing!
Large Language Models
Transformer
![[OmniGen] All Image-](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/September2024/omnigen-520x300.png)
[OmniGen] All Image-related Tasks Can Be Performed With Only One Generation Model!
[OmniGen] All Image-related Tasks Can Be Performed With Only One Generation Model!
Image Generation
SkySense: Multimodal Remote Sensing Foundation Model
SkySense: Multimodal Remote Sensing Foundation Model
CVPR
Google's High-performance LLM That Compresses Very Long Prompt Sentences To Save Memory
Google's High-performance LLM That Compresses Very Long Prompt Sentences To Save Memory
Large Language Models
GenTron: Diffusion Transformers For Image And Video Generation
GenTron: Diffusion Transformers For Image And Video Generation
Image Generation
![[BitNet] Large-scale](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/July2024/bitnet-520x300.png)
[BitNet] Large-scale Language Model With 1-bit Inference
[BitNet] Large-scale Language Model With 1-bit Inference
BitNet
Self-supervised ViT With Deep Fake Detection
Self-supervised ViT With Deep Fake Detection
Self-supervised Learning
![[IGModel] Methodolog](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/July2024/igmodel-520x300.png)
[IGModel] Methodology Applying GNN+Attention Mechanism Improves Practicality In Drug Discovery
[IGModel] Methodology Applying GNN+Attention Mechanism Improves Practicality In Drug Discovery
Medical
![[Mustango] Music Gen](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/June2024/mustango-520x300.png)
[Mustango] Music Generation Model Utilizing Domain Knowledge Of Music
[Mustango] Music Generation Model Utilizing Domain Knowledge Of Music
Audio And Speech Processing
![[VoiceCraft] A Langu](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/June2024/voice-craft-520x300.png)
[VoiceCraft] A Language Model That Synthesizes Natural Speech At The Highest Level In The Industry
[VoiceCraft] A Language Model That Synthesizes Natural Speech At The Highest Level In The Industry
Speech Synthesis
A Method To Automatically Evaluate "the Accuracy Of LLM's Output Of Long Sentences" Was Created
A Method To Automatically Evaluate "the Accuracy Of LLM's Output Of Long Sentences" Was Created
Large Language Models
The Future Of Chemical Research And New Drug Development Created By Transformers And Large-Scale Language Models
The Future Of Chemical Research And New Drug Development Created By Transformers And Large-Scale Lan ...
Large Language Models
Significantly Improved Performance Of Graph Neural Networks By Focusing On Dual Connectivity
Significantly Improved Performance Of Graph Neural Networks By Focusing On Dual Connectivity
GNN
Detecting Fake Images With CLIP: Image-Language Model For Fake Detection
Detecting Fake Images With CLIP: Image-Language Model For Fake Detection
Fake Detection
OpenToM, A Benchmark For Evaluating Whether An LLM Has A "theory Of Mind," Is Now Available!
OpenToM, A Benchmark For Evaluating Whether An LLM Has A "theory Of Mind," Is Now Available!
Datasets
ADD: Diffusion Model With Adversarial Learning And Knowledge Distillation
ADD: Diffusion Model With Adversarial Learning And Knowledge Distillation
Image Generation
Apple Developed A Large Scale Autoregressive Image Model That Is Scalable Like An LLM.
Apple Developed A Large Scale Autoregressive Image Model That Is Scalable Like An LLM.
Computer Vision
![[Swin Transformer] T](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/February2024/swin_transformer-520x300.png)
[Swin Transformer] Transformer-based Image Recognition Models To Keep Now!
[Swin Transformer] Transformer-based Image Recognition Models To Keep Now!
Image Recognition