Code Monkey home page Code Monkey logo

llmsurveysummary's Introduction

LLM Survey Summary

A collection of survey papers and resources related to Large Language Models (LLMs).

Table of Contents

Collection of LLMs Survey

Category Title Venue Release Date Links
Comprehensive A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT arXiv 07 Mar 2023 Paper
Language Model Behavior: A Comprehensive Survey arXiv 20 Mar 2023 Paper
A Survey of Large Language Models arXiv 31 Mar 2023 Paper
A Bibliometric Review of Large Language Models Research from 2017 to 2023 arXiv 03 Apr 2023 Paper
One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era arXiv 04 Apr 2023 Paper
Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models arXiv 04 Apr 2023 Paper
ChatGPT: A Comprehensive Review on Background, Applications, Key Challenges, Bias, Ethics, Limitations and Future Scope ScienceDirect 14 Apr 2023 Paper
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond arXiv 26 Apr 2023 Paper
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey arXiv 30 May 2023 Paper
Several categories of Large Language Models (LLMs): A Short Survey arXiv 05 Jul 2023 Paper
ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey arXiv 09 Jul 2023 Paper
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects TechRxiv 10 Jul 2023 Paper
A Comprehensive Overview of Large Language Models arXiv 12 Jul 2023 Paper
Challenges and Applications of Large Language Models arXiv 19 Jul 2023 Paper
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4 arXiv 04 Oct 2023 Paper
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey arXiv 21 Nov 2023 Paper
ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? arXiv 28 Nov 2023 Paper
Trustworthy The Science of Detecting LLM-Generated Texts arXiv 04 Feb 2023 Paper
Survey of Hallucination in Natural Language Generation ACM 03 Mar 2023 Paper
Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review arXiv 17 Mar 2023 Paper
ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review arXiv 13 Apr 2023 Paper
A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation arXiv 19 May 2023 Paper
Tricking LLMs into Disobedience: Understanding, Analyzing, and Preventing Jailbreaks arXiv 24 May 2023 Paper
A Critical Review of Large Language Models: Sensitivity, Bias, and the Path Toward Specialized AI arXiv 28 Jul 2023 Paper
A Survey on Fairness in Large Language Models arXiv 20 Aug 2023 Paper
Bias and Fairness in Large Language Models: A Survey arXiv 02 Sep 2023 Paper
Explainability for Large Language Models: A Survey arXiv 02 Sep 2023 Paper
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models arXiv 03 Sep 2023 Paper
A Survey of Hallucination in Large Foundation Models arXiv 12 Sep 2023 Paper
Cognitive Mirage: A Review of Hallucinations in Large Language Models arXiv 13 Sep 2023 Paper
People's Perceptions Toward Bias and Related Concepts in Large Language Models: A Systematic Review arXiv 25 Sep 2023 Paper
Ethical Challenges of Large Language Models-A Systematic Literature Review helda.helsinki.fi 26 Sep 2023 Paper
Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks arXiv 16 Oct 2023 Paper
Large Language Models as Subpopulation Representative Models: A Review arXiv 27 Oct 2023 Paper
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions arXiv 09 Nov 2023 Paper
Prompting Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing arXiv 28 Jul 2021 Paper
A Survey on In-context Learning arXiv 31 Dec 2022 Paper
Augmented Language Models: A Survey arXiv 15 Feb 2023 Paper
Towards Reasoning in Large Language Models: A Survey ACL Anthology 01 Jul 2023 Paper
A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models arXiv 24 Jul 2023 Paper
Towards Better Chain-of-Thought Prompting Strategies: A Survey arXiv 08 Oct 2023 Paper
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances arXiv 11 Oct 2023 Paper
Unleashing The Potential of Prompt Engineering in Large Language Models: A Comprehensive Review arXiv 23 Oct 2023 Paper
Knowledge Editing for Large Language Models: A Survey arXiv 24 Oct 2023 Paper
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications arXiv 10 Nov 2023 Paper
Igniting Language Intelligence: The Hitchhiker’s Guide From Chain-of-Thought Reasoning to Language Agents arXiv 20 Nov 2023 Paper
Prompting Frameworks for Large Language Models: A Survey arXiv 21 Nov 2023 Paper
Bioinformatics The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs arXiv 22 Mar 2023 Paper
A Survey for Biomedical Text Summarization: From Pre-trained to Large Language Models arXiv 18 Apr 2023 Paper
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps arXiv 10 May 2023 Paper
Large Language Models in Medicine Nature 17 Jul 2023 Paper
ChatGPT for Shaping The Future of Dentistry: The Potential of Multi-modal Large Language Model Nature 28 Jul 2023 Paper
Large Language Models (LLMs) and Empathy – A Systematic Review medRxiv 07 Aug 2023 Paper
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics arXiv 09 Oct 2023 Paper
The Future Landscape of Large Language Models in Medicine Nature 10 Oct 2023 Paper
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review arXiv 03 Nov 2023 Paper
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge arXiv 09 Nov 2023 Paper
Multi-modal
Pre-training
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT arXiv 18 Feb 2023 Paper
The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges arXiv 04 Mar 2023 Paper
A Survey on Multimodal Large Language Models arXiv 23 Jun 2023 Paper
Examining User-Friendly and Open-Sourced Large GPT Models: A Survey on Language, Multimodal, and Scientific GPT Models arXiv 27 Aug 2023 Paper
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey arXiv 01 Nov 2023 Paper
How to Bridge the Gap between Modalities: A Comprehensive Survey on Multimodal Large Language Model arXiv 10 Nov 2023 Paper
Multimodal Large Language Models: A Survey arXiv 22 Nov 2023 Paper
Large Language Models Meet Computer Vision: A Brief Survey arXiv 28 Nov 2023 Paper
RecSys
IR
A Survey on Large Language Models for Recommendation arXiv 31 May 2023 Paper
How Can Recommender Systems Benefit from Large Language Models: A Survey arXiv 09 Jun 2023 Paper
Recommender Systems in the Era of Large Language Models (LLMs) arXiv 05 Jul 2023 Paper
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities arXiv 31 Jul 2023 Paper
Large Language Models for Information Retrieval: A Survey arXiv 14 Aug 2023 Paper
Large Language Models for Generative Recommendation: A Survey and Visionary Discussions arXiv 03 Sep 2023 Paper
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity arXiv 11 Oct 2023 Paper
A Survey on Large Language Models for Personalized and Explainable Recommendations arXiv 21 Nov 2023 Paper
Adaptation Tuning Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation arXiv 01 May 2023 Paper
Efficient Methods for Natural Language Processing: A Survey ACL Anthology 12 Jul 2023 Paper
Aligning Large Language Models with Human: A Survey arXiv 24 Jul 2023 Paper
Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies arXiv 06 Aug 2023 Paper
Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models' Alignment arXiv 10 Aug 2023 Paper
Instruction Tuning for Large Language Models: A Survey arXiv 21 Aug 2023 Paper
Large Language Model Alignment: A Survey arXiv 26 Sep 2023 Paper
Robotics A Survey on Large Language Model based Autonomous Agents arXiv 22 Aug 2023 Paper
The Rise and Potential of Large Language Model Based Agents: A Survey arXiv 14 Sep 2023 Paper
An In-depth Survey of Large Language Model-based Artificial Intelligence Agents arXiv 23 Sep 2023 Paper
Large language models for human–robot interaction: A review ScienceDirect 28 Oct 2023 Paper
A Survey of Large Language Models for Autonomous Driving arXiv 02 Nov 2023 Paper
Large Language Models for Robotics: A Survey arXiv 13 Nov 2023 Paper
A Survey on Multimodal Large Language Models for Autonomous Driving arXiv 21 Nov 2023 Paper
Graphs Graph Learning and Its Advancements on Large Language Models: A Holistic Survey arXiv 17 Dec 2022 Paper
A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges arXiv 13 Mar 2023 Paper
Unifying Large Language Models and Knowledge Graphs: A Roadmap arXiv 14 Jun 2023 Paper
ChatGPT is not Enough: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling arXiv 20 Jun 2023 Paper
Large Language Models and Knowledge Graphs: Opportunities and Challenges arXiv 11 Aug 2023 Paper
A Survey of Graph Meets Large Language Model: Progress and Future Directions arXiv 21 Nov 2023 Paper
Graph Prompt Learning: A Comprehensive Survey and Beyond arXiv 28 Nov 2023 Paper
Software Engineering Large Language Models Meet NL2Code: A Survey arXiv 01 Jul 2023 Paper
Software Testing with Large Language Model: Survey, Landscape, and Vision arXiv 14 Jul 2023 Paper
Towards Understanding the Capability of Large Language Models on Code Clone Detection: A Survey arXiv 02 Aug 2023 Paper
Large Language Models for Software Engineering: A Systematic Literature Review arXiv 21 Aug 2023 Paper
Large Language Models for Software Engineering: Survey and Open Problems arXiv 05 Oct 2023 Paper
A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends arXiv 17 Nov 2023 Paper
Evaluation A Survey on Evaluation of Large Language Models arXiv 06 Jul 2023 Paper
Through the Lens of Core Competency: Survey on Evaluation of Large Language Models arXiv 15 Aug 2023 Paper
Evaluating Large Language Models: A Comprehensive Survey arXiv 30 Oct 2023 Paper
Education ChatGPT for good? On opportunities and challenges of large language models for education ScienceDirect 09 Mar 2023 Paper
Law A Short Survey of Viewing Large Language Models in Legal Aspect arXiv 16 Mar 2023 Paper
Finance Large Language Models in Finance: A Survey arXiv 28 Sep 2023 Paper
Others The Life Cycle of Knowledge in Big Language Models: A Survey arXiv 14 Mar 2023 Paper
Topics, Authors, and Networks in Large Language Model Research: Trends from a Survey of 17K arXiv Papers arXiv 20 Jul 2023 Paper
A Survey on Model Compression for Large Language Models arXiv 15 Aug 2023 Paper
Document Automation Architectures: Updated Survey in Light of Large Language Models arXiv 18 Aug 2023 Paper
When Large Language Models Meet Citation: A Survey arXiv 18 Sep 2023 Paper
A Survey of Large Language Models Attribution arXiv 07 Nov 2023 Paper

Acknowledgments

Update Log

  • 2023-10-04: Released the first draft of the survey summary for LLMs.
  • 2023-10-07: Added three survey papers about LLMs for graphs.
  • 2023-10-10: Included one survey paper about LLMs for healthcare.
  • 2023-10-19: Appended two survey papers about LLMs for software engineering.
  • 2023-10-29: Added one comprehensive survey and four surveys for trustworthiness.
  • 2023-11-05: Incorporated one survey for factuality issues in knowledge and retrieval.
  • 2023-11-11: Collected nine survey papers across seven categories.
  • 2023-11-18: Updated the category and supplemented nineteen survey papers.
  • 2023-11-23: Included ten survey papers across eight categories.
  • 2023-11-30: Created a new category: education; updated nineteen survey papers across eight categories.
  • 2023-12-03: Replenished five survey papers across three categories.

llmsurveysummary's People

Contributors

junzhuang-code avatar

Stargazers

 avatar  avatar Bryce Wang avatar  avatar  avatar Sheng Guan avatar  avatar  avatar Zhezheng Hao avatar Shaohang Wei avatar TioeAre avatar SVicen avatar ZhongYi avatar  avatar  avatar  avatar  avatar  avatar Si Chengliang avatar Kerwin Wilson avatar jason law avatar  avatar Yi Wu  avatar Changho Shin avatar Zhenmei Shi avatar  avatar YrYang avatar han avatar  avatar  avatar  avatar Conna avatar Yibin Liu avatar Yaya Shi avatar  avatar Buluchacha avatar Yuqian Fu avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.