Academic Articles & Research Papers

Deep neural network-based prediction of tsunami wave attenuation by mangrove forests

The goal of this research is to develop a model employing deep neural networks (DNNs) to predict the effectiveness of mangrove forests in attenuating the impact of tsunami waves. The dataset for the DNN model is obtained by simulating tsuna...

A Fast and Generalizable Deep Neural Network for the Detection of Atrial Fibrillation.

Field-Aware Click-Through Rate Prediction Model Based on Attention Mechanism

Click-Through Rate(CTR) prediction is one of the most important tools for ad placement.Predicting the CTR of an ad and making recommendations to users can increase ad revenue.Field-aware click-through rate prediction models are superior to ...

BP Neural Network–Based Kalman Filtering Method Under Multiple Cyberattacks

This paper proposes a Kalman-gain-driven neural Kalman filtering (KF) defense framework, termed KFDBP, for secure state estimation in cyber–physical systems (CPSs) under denial-of-service (DoS), spoofing, and replay attacks. Unlike end-to-e...

Explainable machine learning in materials science

Abstract Machine learning models are increasingly used in materials studies because of their exceptional accuracy. However, the most accurate machine learning models are usually difficult to explain. Remedies to this problem lie in explaina...

Generating Daily High-Resolution Regional XCO₂ by Deep Neural Network and Multi-Source Data

CO2 is one of the primary greenhouse gases impacting global climate change, making it crucial to understand the spatiotemporal variations of CO2. Currently, commonly used satellites serve as the primary means of CO2 observation, but they of...

Evaluating Uses of Deep Learning Methods for Causal Inference

Logistic regression (LR) is a popular method that is used for estimating causal effects in observational studies using propensity scores. We examine the use of deep learning models such as the deep neural network (DNN), PropensityNet (PN), ...

Discriminating Similar Naval Vessels Using YOLOv8 Deep Neural Network

The next generation of United States Navy uncrewed aerial systems (UASs) is expected to operate in global positioning system and radio frequency-denied maritime environments. In these challenging conditions, these UASs must accurately ident...

Deep Neural Networks for Natural Language Processing

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During t...

A survey of uncertainty in deep neural networks

Abstract Over the last decade, neural networks have reached almost every field of science and become a crucial part of various real world applications. Due to the increasing spread, confidence in neural network predictions has become more a...

A Survey on Neural Network Interpretability

Along with the great success of deep neural networks, there is also growing concern about their black-box nature. The interpretability issue affects people's trust on deep learning systems. It is also related to many ethical problems, e.g.,...

iNNvestigate neural networks!

In recent years, deep neural networks have revolutionized many application domains of machine learning and are key components of many critical decision or predictive processes. Therefore, it is crucial that domain specialists can understand...

Understanding of a convolutional neural network

The term Deep Learning or Deep Neural Network refers to Artificial Neural Networks (ANN) with multi layers. Over the last few decades, it has been considered to be one of the most powerful tools, and has become very popular in the literatur...

Tensorizing Neural Networks

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational resources. In particular, a large amount of memory is required b...

Intriguing properties of neural networks

Deep neural networks are highly expressive models that have recently achieved state of the art performance on speech and visual recognition tasks. While their expressiveness is the reason they succeed, it also causes them to learn uninterpr...

On Interpretability of Artificial Neural Networks: A Survey

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success recently in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become ...

Applied Deep Learning

Work with advanced topics in deep learning, such as optimization algorithms, hyper-parameter tuning, dropout, and error analysis as well as strategies to address typical problems encountered when training deep neural networks, in this compr...

ℤ₂ × ℤ₂ Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks

This paper presents a comparative analysis of the performance of Equivariant Quantum Neural Networks (EQNNs) and Quantum Neural Networks (QNNs), juxtaposed against their classical counterparts: Equivariant Neural Networks (ENNs) and Deep Ne...

Bias and Fairness in Natural Language Processing

Recent advances in data-driven machine learning techniques (e.g., deep neural networks) have revolutionized many natural language processing applications. These approaches automatically learn how to make decisions based on the statistics an...