natural language processing (NLP)

Natural language processing (NLP) is a field of computer science and artificial intelligence that enables computers to analyze, interpret, generate, and interact with human language in text and speech.

NLP combines ideas from computational linguistics with statistics and machine learning to build models for tasks such as tokenization, tagging, parsing, text classification, translation, question answering, and dialog.

Approaches to NLP have evolved from rule-based systems to data-driven methods, with modern systems typically using neural networks and transformer-based language models trained on large text corpora. Today, a single large language model is often prompted or fine-tuned to handle many of these tasks at once, instead of training a separate model for each task.

Related Resources

Tutorial

Natural Language Processing With spaCy in Python

In this step-by-step tutorial, you'll learn how to use spaCy. This free and open-source library for natural language processing (NLP) in Python has a lot of built-in capabilities and is becoming increasingly popular for processing and analyzing data in NLP.

intermediate data-science