Hausarbeiten logo
Shop
Shop
Tutorials
En De
Shop
Tutorials
  • How to find your topic
  • How to research effectively
  • How to structure an academic paper
  • How to cite correctly
  • How to format in Word
Trends
FAQ
Go to shop › Computer Sciences - Computational linguistics

Multi-Modal Machine Learning. An Introduction to BERT Pre-Trained Visio-Linguistic Models

Title: Multi-Modal Machine Learning. An Introduction to BERT Pre-Trained Visio-Linguistic Models

Seminar Paper , 2021 , 22 Pages , Grade: 1,3

Autor:in: Johanna Garthe (Author)

Computer Sciences - Computational linguistics

Excerpt & Details   Look inside the ebook
Summary Excerpt Details

In the field of multi-modal machine learning, where the fusion of various sensory inputs shapes learning paradigms, this paper provides an introduction to BERT-based pre-trained visio-linguistic models by specifically summarizing and analyzing two approaches: ViLBERT and VL-BERT, aiming to highlight and discuss their distinctive characteristics. The paper is structured into five chapters as follows. Chapter 2 lays the fundamental principles by introducing the characteristics of the Transformer encoder and BERT. Chapter 3 presents the selected visual-linguistic models, ViLBERT and VL-BERT. The objective of chapter 4 is to summarize and discuss both models. The paper concludes with an outlook in chapter 5.

Transfer learning is a powerful technique in the field of deep learning. At first, a model is pre-trained on a specific task. Then fine-tuning is performed by taking the trained network as the basis of a new purpose-specific model to apply it on a separate task. In this way, transfer learning helps to reduce the need to develop new models for new tasks from scratch and hence saves time for training and verification. Nowadays, there are different such pre-trained models in computer vision, natural language processing (NLP) and recently for visio-linguistic tasks. The pre-trained models presented later in this paper are both based on and use BERT. BERT, which stands for Bidirectional Encoder Representations from Transformers, is a popular training technique for NLP, which is based on the architecture of a Transformer.

Excerpt


Inhaltsverzeichnis (Table of Contents)

  • Introduction
  • Fundamental Principles
    • Transformer
    • BERT
  • Visio-Linguistic Models
    • VILBERT
    • VL-BERT
  • Discussion
  • Outlook

Zielsetzung und Themenschwerpunkte (Objectives and Key Themes)

This seminar paper aims to introduce BERT pre-trained visio-linguistic models by summarizing two recent published approaches, VILBERT and VL-BERT, and discussing their characteristics.

  • Multi-modal machine learning
  • BERT pre-trained visio-linguistic models
  • Comparison of VILBERT and VL-BERT
  • Characteristics and functionalities of the models
  • Applications and future directions

Zusammenfassung der Kapitel (Chapter Summaries)

  • Introduction: This chapter introduces the concept of multi-modal machine learning and its relevance in artificial intelligence, highlighting the importance of integrating various sensory modalities for learning and processing information. It also introduces the specific focus of the paper: BERT pre-trained visio-linguistic models and the models that will be discussed.
  • Fundamental Principles: This chapter establishes the foundations for understanding the selected models by explaining the core principles of the Transformer encoder and BERT, two essential components of the chosen models. It provides insights into their architectures and functionalities, preparing the reader for the detailed analysis of specific models.
  • Visio-Linguistic Models: This chapter dives into the heart of the paper, presenting the two selected visual-linguistic models, VILBERT and VL-BERT. The chapter highlights the key features, architecture, and pre-training procedures of each model, providing a detailed exploration of their functionalities and capabilities.

Schlüsselwörter (Keywords)

The primary focus of this seminar paper lies on multi-modal machine learning, especially in the context of visio-linguistic models. This includes the analysis of BERT pre-trained models like VILBERT and VL-BERT. The paper examines their architectures, functionalities, pre-training tasks, and potential applications within this specific field. Key terms encompass transformer encoder, BERT, visual-linguistic models, co-attention, and pre-training techniques.

Excerpt out of 22 pages  - scroll top

Details

Title
Multi-Modal Machine Learning. An Introduction to BERT Pre-Trained Visio-Linguistic Models
College
University of Trier  (Computerlinguistik und Digital Humanities)
Course
Mathematische Modellierung
Grade
1,3
Author
Johanna Garthe (Author)
Publication Year
2021
Pages
22
Catalog Number
V1431361
ISBN (eBook)
9783346983749
ISBN (Book)
9783346983756
Language
English
Tags
Multi-Modal Machine Learning Machine Learning NLP Natural Language Processing BERT Transformer
Product Safety
GRIN Publishing GmbH
Quote paper
Johanna Garthe (Author), 2021, Multi-Modal Machine Learning. An Introduction to BERT Pre-Trained Visio-Linguistic Models, Munich, GRIN Verlag, https://www.hausarbeiten.de/document/1431361
Look inside the ebook
  • Depending on your browser, you might see this message in place of the failed image.
  • https://cdn.openpublishing.com/images/brand/2/preview_popup_advertising.jpg
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
  • Depending on your browser, you might see this message in place of the failed image.
Excerpt from  22  pages
Hausarbeiten logo
  • Facebook
  • Instagram
  • TikTok
  • Shop
  • Tutorials
  • FAQ
  • Payment & Shipping
  • About us
  • Contact
  • Privacy
  • Terms
  • Imprint