large language model (LLM)
A large language model (LLM) is a neural network trained on very large text corpora using self-supervised objectives, such as next-token prediction or masked modeling, to predict missing or future tokens, enabling broad language understanding and generation.
Modern LLMs are typically transformer-based and are pre-trained once on large unlabeled text corpora, then adapted to downstream tasks via prompting, fine-tuning, or intermediate techniques, such as instruction tuning or reinforcement learning from human feedback. Many current LLMs are also multimodal: the same pre-training and adaptation recipe extends beyond text, so a model can take in or produce images, audio, and other data alongside tokens of text.
They support multiple capabilities, such as text generation, summarization, question answering, translation, and code generation. However, they also inherit limitations from their training data and modeling process, including factual inaccuracies, biases, limited context window, and failures in reasoning or coherence.
Related Resources
Tutorial
Build an LLM RAG Chatbot With LangChain
Large language models (LLMs) have taken the world by storm, demonstrating unprecedented capabilities in natural language tasks. In this step-by-step tutorial, you'll leverage LLMs to build your own retrieval-augmented generation (RAG) chatbot using synthetic data with LangChain and Neo4j.
For additional information on related topics, take a look at the following resources:
- Simon Willison: Using LLMs for Python Development (Podcast)
- How to Use Ollama to Run Large Language Models Locally (Tutorial)
- Pydantic AI: Build Type-Safe LLM Agents in Python (Tutorial)
- Measuring Bias, Toxicity, and Truthfulness in LLMs With Python (Podcast)
- Leveraging Documents and Data to Create a Custom LLM Chatbot (Podcast)
- Prompt Engineering: A Practical Example (Tutorial)
- Embeddings and Vector Databases With ChromaDB (Tutorial)
- Connecting LLMs to Your Data With Python MCP Servers (Course)
- How to Integrate ChatGPT's API With Python Projects (Tutorial)
- First Steps With LangChain (Course)
- Build an LLM RAG Chatbot With LangChain (Quiz)
- How to Use Ollama to Run Large Language Models Locally (Quiz)
- Building Type-Safe LLM Agents With Pydantic AI (Course)
- Pydantic AI: Build Type-Safe LLM Agents in Python (Quiz)
- Practical Prompt Engineering (Quiz)
- Vector Databases and Embeddings With ChromaDB (Course)
- Embeddings and Vector Databases With ChromaDB (Quiz)
- Leverage OpenAI's API in Your Python Projects (Course)
- How to Integrate ChatGPT's API With Python Projects (Quiz)
