Academic Articles & Research Papers

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A prevailing a...

Stanza: A Python Natural Language Processing Toolkit for Many Human Languages

We introduce Sta n z a , an open-source Python natural language processing toolkit supporting 66 human languages.Compared to existing widely used toolkits, Sta n z a features a language-agnostic fully neural pipeline for text analysis, incl...

A Survey on Gender Bias in Natural Language Processing

Language can be used as a means of reproducing and enforcing harmful stereotypes and biases and has been analysed as such in numerous research. In this paper, we present a survey of 304 papers on gender bias in natural language processing. ...

Digital footprints as a tool to evaluate the spatiotemporal environmental impacts of grocery shopping across Great Britain

Introduction & Background Climate change represents one of the most pressing challenges of our time. Within this context, the food sector is a critical domain for intervention, accounting for approximately one-third of global greenhouse gas...

Empowering text classification with NLP and explainable AI for enhanced interpretability

Abstract Artificial intelligence (AI) models have demonstrated significant success in classifying various types of text. However, the complex nature of these models often complicates the interpretability of their classifications. To address...

Transformer-Based Abstractive Summarization for Reddit and Twitter: Single Posts vs. Comment Pools in Three Languages

Abstractive summarization is a technique that allows for extracting condensed meanings from long texts, with a variety of potential practical applications. Nonetheless, today’s abstractive summarization research is limited to testing the mo...

FREDC: A Few-Shot Relation Extraction Dataset for Chinese

Few-shot relation extraction (RE) is a critical task in natural language processing (NLP), yet benchmark datasets for non-English languages, particularly Chinese, remain scarce. Owing to their narrow focus and insufficient coverage of relat...

The Effectiveness of Arabic Stemmers Using Arabized Word Removal

Other languages have influenced Arabic because of several factors, such as geographical nearness, trade communication, past Islamic conquests, science and technology, new devices, brand names, models, and fashion. As a result of these facto...

One Picture and One Thousand Words: Toward integrated multimodal generative models

Thanks to independent advances in language and image generation, we could soon be in the position to have systems that communicate with us by combining language and images in their output, a skill that humans do not possess (we receive, but...

Large Language Models and 3D Vision for Intelligent Robotic Perception and Autonomy

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables ...

A Survey on Natural Language Processing for Fake News Detection

Fake news detection is a critical yet challenging problem in Natural Language Processing (NLP). The rapid rise of social networking platforms has not only yielded a vast increase in information accessibility but has also accelerated the spr...

Data augmentation approaches in natural language processing: A survey

As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in...

Ten rules for robust taxonomy in ecological datasets.

A systematic literature review on spam content detection and classification

The presence of spam content in social media is tremendously increasing, and therefore the detection of spam has become vital. The spam contents increase as people extensively use social media, i.e., Facebook, Twitter, YouTube, and E-mail. ...

Machine learning with persistent homology and chemical word embeddings improves prediction accuracy and interpretability in metal-organic frameworks

Abstract Machine learning has emerged as a powerful approach in materials discovery. Its major challenge is selecting features that create interpretable representations of materials, useful across multiple prediction tasks. We introduce an ...

Natural Language Processing

This chapter starts with several generic sections about natural language processing (NLP) datasets and big-picture concepts. It focuses on the core NLP concepts, and quick-and-dirty techniques to more complicated ones. The most basic concep...

Graph Neural Networks for Natural Language Processing: A Survey

Deep learning has become the dominant approach in addressing various tasks in Natural Language Processing (NLP). Although text inputs are typically represented as a sequence of tokens, there is a rich variety of NLP problems that can be bes...

A new image similarity metric for a perceptual and transparent geometric and chromatic assessment

Abstract Full-reference image quality assessment metrics such as PSNR and SSIM misalign with human perceptual judgments on texture and shape distortions, a limitation documented across multiple benchmarks. Deep perceptual metrics such as LP...

Cracking the code: AI’s role in mapping evidence syntheses to the United Nations sustainable development goals

Abstract Background Understanding the alignment and contributions of research to the United Nations Sustainable Development Goals (UN SDGs) is essential for guiding global progress toward these critical targets. Several SDG mapping approach...

Datasets: A Community Library for Natural Language Processing

Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, Joe Davison, Mario Šaško, Gunjan Chhablani, Bhavitvya Malik, Simon Bra...