Finally, tomorrow we will learn from @TheShubhanshu. His talk is called "Understanding digital social trace data via Information Extraction"
Abstract:
I will describe how to efficiently extract information (e.g. phrases, named entities, and categories like topics, sentiment,(1/5)
I will end with ways on improving text classification via features derived from the DSTD representation. Details can be found at shubhanshu.com/phd_thesis/. (4/5)
The second talk on the agenda of our upcoming NLP meetup is "Learning to translate with JoeyNMT" by @KreutzerJulia.
Abstract:
Machine translation is one of the most impactful NLP applications. Despite many toolkits for it being open-sourced, 1/3
we realized there was something missing: one that is developed for beginners and newcomers to the field. In this talk, we will get to know the JoeyNMT toolkit (github.com/joeynmt), a minimalist toolkit for machine translation built on PyTorch. 2/3
The first talk of our next meetup: "Fine-tuning a large language model without your own supercomputer" by @GuggerSylvain
Abstract:
State-of-the-art results in NLP involve more and more the use of a generic pretrained language model fine-tuned on a specific downstream task. 1/4
and show how to apply them on an example of fine-tuning. In particular, we will see how the variants of ZeRO are currently implemented in the Transformers library, by the use of fairscale and deepspeed. 4/4