Reset
Showing 18 of 38 academic articles

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

裕二 池谷, Robert Tinn, Hao Cheng, MICHAEL A. LUCAS et al. • ACM Transactions on Computing for Healthcare (2021)

Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on general domain corpora, such as newswire and Web. A prevailing a...

OPENALEX Open Access DOI: https://doi.org/10.1145/3458754

Digital footprints as a tool to evaluate the spatiotemporal environmental impacts of grocery shopping across Great Britain

Gavin Long, Evgeniya Lukinova, John Harvey, Joanne Parkes et al. • International Journal of Population Data Science (2025)

Introduction & Background Climate change represents one of the most pressing challenges of our time. Within this context, the food sector is a critical domain for intervention, accounting for approximately one-third of global greenhouse gas...

DOAJ Open Access (DOAJ) DOI: 10.23889/ijpds.v10i5.3336

Enhancing educational semantic retrieval through dual objective fine tuning of open source embedding models

Ramteja Sajja, Yusuf Sermet, Ibrahim Demir • Discover Education (2026)

Abstract Recent advances in AI have catalyzed the adoption of intelligent educational tools, yet many semantic retrieval systems remain ill-suited to the unique linguistic and structural characteristics of academic content. This study prese...

DOAJ Open Access (DOAJ) DOI: 10.1007/s44217-026-01825-y

A Model-Driven Approach Employing DSL and Generation Templates to Accelerate the Development of Conversational Agents for Smart Tourism

Charaf Ouaddi, Lamya Benaddi, Adnane Souha, Hamza Abdelmalek et al. • IEEE Access (2025)

Conversational agents are intelligent, ubiquitous software applications widely used across various sectors, such as commerce, tourism, and more. Their key benefits include automating tasks, improving customer service, and ensuring service a...

DOAJ Open Access (DOAJ) DOI: 10.1109/ACCESS.2025.3574641

An Analysis of the Training Data Impact for Domain-Adapted Tokenizer Performances—The Case of Serbian Legal Domain Adaptation

Miloš Bogdanović, Milena Frtunić Gligorijević, Jelena Kocić, Leonid Stoimenov • Applied Sciences (2025)

Various areas of natural language processing (NLP) have greatly benefited from the development of large language models in recent years. This research addresses the challenge of developing efficient tokenizers for transformer-based domain-s...

DOAJ Open Access (DOAJ) DOI: 10.3390/app15137491

Natural Language Processing for Requirements Engineering

Liping Zhao, Waad Alhoshan, Alessio Ferrari, Keletso J. Letsholo et al. • ACM Computing Surveys (2021)

Natural Language Processing for Requirements Engineering (NLP4RE) is an area of research and development that seeks to apply natural language processing (NLP) techniques, tools, and resources to the requirements engineering (RE) process, to...

OPENALEX Open Access DOI: https://doi.org/10.1145/3444689

Enhancing image caption generation through context-aware attention mechanism

Ahatesham Bhuiyan, Eftekhar Hossain, Mohammed Moshiul Hoque, M. Ali Akber Dewan • Heliyon (2024)

Image captioning, the process of generating natural language descriptions based on image content, has garnered attention in AI research for its implications in scene understanding and human-computer interaction. While much prior research ha...

DOAJ Open Access (DOAJ) DOI: 10.1016/j.heliyon.2024.e36272

A Survey on Deep Learning for Named Entity Recognition

Jing Li, Aixin Sun, Jianglei Han, Chenliang Li • IEEE Transactions on Knowledge and Data Engineering (2020)

Named entity recognition (NER) is the task to identify mentions of rigid designators from text belonging to predefined semantic types such as person, location, organization etc. NER always serves as the foundation for many natural language ...

OPENALEX Open Access DOI: https://doi.org/10.1109/tkde.2020.2981314

Review of Deep Learning for Language Modeling

WANG Sili, ZHANG Ling, YANG Heng, LIU Wei • Nongye tushu qingbao xuebao (2023)

[Purpose/Significance] Deep learning for language modeling is one of the major methods and advanced technologies to enhance language intelligence of machines at present, which has become an indispensable important technical means for automa...

DOAJ Open Access (DOAJ) DOI: 10.13998/j.cnki.issn1002-1248.23-0251

Machine learning in pain research

Jörn Lötsch, Alfred Ultsch • Pain (2017)

1. Introduction Pain and pain chronification are incompletely understood and unresolved medical problems that continue to have a high prevalence.14 It has been accepted that pain is a complex phenomenon.2,32,72 Contemporary methods of compu...

OPENALEX cc-by-nc-nd DOI: https://doi.org/10.1097/j.pain.0000000000001118 PMC: 5895117

Raman Spectroscopy Pre-Trained Encoder: A Self-Supervised Learning Approach for Data-Efficient Domain-Independent Spectroscopy Analysis

Abhiraam Eranti, Yogesh Tewari, Rafael Palacios, Amar Gupta • IEEE Access (2026)

Deep-learning methods have boosted the analytical power of Raman spectroscopy, yet they still require large, task-specific, labeled datasets and often fail to transfer across application domains. The study explores pre-trained encoders as a...

DOAJ Open Access (DOAJ) DOI: 10.1109/ACCESS.2026.3672109