Cross-Layer Attention Significantly Reduces Transformer Memory
Cross-Layer Attention Significantly Reduces Transformer Memory
Transformer
Transformer
YesBut: The Emergence Of A Dataset That Makes The VLM Understand Irony And Caricature!
YesBut: The Emergence Of A Dataset That Makes The VLM Understand Irony And Caricature!
Dataset
![[SCoRe] Reinforcemen](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/October2024/score-520x300.png)
[SCoRe] Reinforcement Learning To Enhance LLM's Ability To Self-correct! Identify And Correct Errors In A Multi-step Process
[SCoRe] Reinforcement Learning To Enhance LLM's Ability To Self-correct! Identify And Correct Errors ...
Large Language Models
AI To Transform Mathematics Education; Possibilities And Challenges Of Solving Mathematical Problems Using Large-Scale Language Mo ...
AI To Transform Mathematics Education; Possibilities And Challenges Of Solving Mathematical Problems ...
Large Language Models
A Better Attention Mechanism Will Improve The Performance Of LLM's Long-text Processing!
A Better Attention Mechanism Will Improve The Performance Of LLM's Long-text Processing!
Large Language Models
![[OmniGen] All Image-](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/September2024/omnigen-520x300.png)
[OmniGen] All Image-related Tasks Can Be Performed With Only One Generation Model!
[OmniGen] All Image-related Tasks Can Be Performed With Only One Generation Model!
Image Generation
SkySense: Multimodal Remote Sensing Foundation Model
SkySense: Multimodal Remote Sensing Foundation Model
CVPR
Google's High-performance LLM That Compresses Very Long Prompt Sentences To Save Memory
Google's High-performance LLM That Compresses Very Long Prompt Sentences To Save Memory
Large Language Models
GenTron: Diffusion Transformers For Image And Video Generation
GenTron: Diffusion Transformers For Image And Video Generation
Image Generation
![[BitNet] Large-scale](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/July2024/bitnet-520x300.png)
[BitNet] Large-scale Language Model With 1-bit Inference
[BitNet] Large-scale Language Model With 1-bit Inference
BitNet
Self-supervised ViT With Deep Fake Detection
Self-supervised ViT With Deep Fake Detection
Self-supervised Learning
![[IGModel] Methodolog](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/July2024/igmodel-520x300.png)
[IGModel] Methodology Applying GNN+Attention Mechanism Improves Practicality In Drug Discovery
[IGModel] Methodology Applying GNN+Attention Mechanism Improves Practicality In Drug Discovery
Medical
![[Mustango] Music Gen](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/June2024/mustango-520x300.png)
[Mustango] Music Generation Model Utilizing Domain Knowledge Of Music
[Mustango] Music Generation Model Utilizing Domain Knowledge Of Music
Audio And Speech Processing
![[VoiceCraft] A Langu](https://aisholar.s3.ap-northeast-1.amazonaws.com/media/June2024/voice-craft-520x300.png)
[VoiceCraft] A Language Model That Synthesizes Natural Speech At The Highest Level In The Industry
[VoiceCraft] A Language Model That Synthesizes Natural Speech At The Highest Level In The Industry
Speech Synthesis
A Method To Automatically Evaluate "the Accuracy Of LLM's Output Of Long Sentences" Was Created
A Method To Automatically Evaluate "the Accuracy Of LLM's Output Of Long Sentences" Was Created
Large Language Models
The Future Of Chemical Research And New Drug Development Created By Transformers And Large-Scale Language Models
The Future Of Chemical Research And New Drug Development Created By Transformers And Large-Scale Lan ...
Large Language Models
Significantly Improved Performance Of Graph Neural Networks By Focusing On Dual Connectivity
Significantly Improved Performance Of Graph Neural Networks By Focusing On Dual Connectivity
GNN
Detecting Fake Images With CLIP: Image-Language Model For Fake Detection
Detecting Fake Images With CLIP: Image-Language Model For Fake Detection
Fake Detection