Contrastive-Learning-NLP-Papers  by ryanzhumich

NLP resource for contrastive learning papers

created 3 years ago
563 stars

Top 58.0% on sourcepulse

GitHubView on GitHub
Project Summary

This repository serves as a curated list of academic papers focused on Contrastive Learning (CL) within the Natural Language Processing (NLP) domain. It aims to provide researchers and practitioners with a comprehensive overview of CL's foundational concepts, methodologies, and diverse applications in NLP tasks, facilitating the adoption and advancement of this representation learning technique.

How It Works

The repository categorizes papers based on their contribution to contrastive learning in NLP, covering foundational principles like loss functions and sampling strategies, to specific applications such as text classification, sentence embeddings, and information extraction. It also includes papers on interpretability, commonsense reasoning, and vision-language tasks, showcasing the breadth of CL's impact.

Highlighted Details

  • Extensive coverage of contrastive learning objectives, sampling strategies, and analysis.
  • Detailed sections on applications across various NLP tasks including text classification, sentence embeddings, information extraction, machine translation, question answering, summarization, and text generation.
  • Inclusion of papers on data-efficient learning, contrastive pretraining, interpretability, commonsense reasoning, and vision-language integration.
  • Links to official websites, slides, videos, and code repositories are provided for many entries.

Maintenance & Community

This is a curated list of papers, not an active software project. The primary contribution is the compilation and organization of research.

Licensing & Compatibility

This repository contains links to external academic papers and does not have its own software license. Compatibility is dependent on the licenses of the linked resources.

Limitations & Caveats

The repository is a static compilation of research papers and does not provide any code, implementations, or benchmarks for contrastive learning methods. Its utility is limited to literature review and discovery.

Health Check
Last commit

2 years ago

Responsiveness

1+ week

Pull Requests (30d)
0
Issues (30d)
0
Star History
8 stars in the last 90 days

Explore Similar Projects

Starred by Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), and
1 more.

nlp-library by mihail911

0%
1k
NLP papers for practitioners
created 8 years ago
updated 5 years ago
Feedback? Help us improve.