Pre-trained models for natural language processing: A survey
https://doi.org/10.1007/s11431-020-1647-3
Discover Books. Explore Knowledge.
Search and discover peer-reviewed scholarly literature, open-access articles, and research citations across DOAJ, PubMed Central, and OpenAlex.
https://doi.org/10.1007/s11431-020-1647-3
https://doi.org/10.1007/978-3-031-02139-8
Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network models started to be ap...
https://doi.org/10.1613/jair.4992
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to ...
https://doi.org/10.48550/arxiv.1910.03771
We describe a single convolutional neural network architecture that, given a sentence, outputs a host of language processing predictions: part-of-speech tags, chunks, named entity tags, semantic roles, semantically similar words and the lik...
https://doi.org/10.1145/1390156.1390177
Abstract Natural language processing is a field that explores computational methods for interpreting and processing natural language, in either textual or spoken form....
https://doi.org/10.1002/0470018860.s00078
Statistical approaches to processing natural language text have become dominant in recent years. This foundational text is the first comprehensive introduction to statistical natural language processing (NLP) to appear. The book contains al...
https://doi.org/10.4324/9781315802671
Natural language processing (NLP) is the study of mathematical and computational modeling of various aspects of language and the development of a wide range of systems. These include spoken language systems that integrate speech and natural...
https://doi.org/10.1126/science.253.5025.1242
The Arabic language presents researchers and developers of natural language processing (NLP) applications for Arabic text and speech with serious challenges. The purpose of this article is to describe some of these challenges and to present...
https://doi.org/10.1145/1644879.1644881
The parliament, as a key component of the public sphere, is both a reflection of and a stage for the post-democratic transition. Our study examines Hungarian parliamentary discourse as an indicator of a transition in which democratic instit...
10.1016/j.ssaho.2026.103122
IntroductionBibliometric analysis is widely acknowledged as a robust and systematic approach for examining extensive scholarly literature. It serves as a vital tool for mapping the landscape of contemporary research across various academic ...
10.22108/jas.2025.144379.2609
This study explores the application of GPT models for automating consumer food survey analysis, focusing on Chinese consumers' acceptance of plant-based foods, cultured meat, insect-based proteins, and microbial proteins. Traditional survey...
10.1016/j.jafr.2025.102086
Natural Language Processing for Requirements Engineering (NLP4RE) is an area of research and development that seeks to apply natural language processing (NLP) techniques, tools, and resources to the requirements engineering (RE) process, to...
https://doi.org/10.1145/3444689
The classic supervised machine learning paradigm is based on learning in isolation, a single predictive model for a task using a single dataset. This approach requires a large number of training examples and performs best for well-defined a...
https://doi.org/10.18653/v1/n19-5004
Natural language processing is widely discussed and researched topic nowadays. As it is one of the oldest area of research in machine learning it is used in major fields such as machine translation speech recognition and text processing. Na...
https://doi.org/10.26438/ijcse/v6i1.161167
Symbolic approaches to natural language processing tokenisation and sentence segmentation lexical analysis parsing techniques semantic analysis discourse structure and intention recognition natural language generation intelligent writing as...
https://doi.org/10.1162/coli.2000.27.4.602
https://doi.org/10.1007/978-3-031-25928-9_5
IMPORTANCE: Natural language processing (NLP) has the potential to accelerate translation of cancer treatments from the laboratory to the clinic and will be a powerful tool in the era of personalized medicine. This technology can harvest im...
https://doi.org/10.1001/jamaoncol.2016.0213
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu...
https://doi.org/10.18653/v1/2020.emnlp-demos.6