Home > Servers > Rack and Tower Servers > Intel > White Papers > Driving GenAI Advancements: Dell PowerEdge R760 with the Latest 5th Gen Intel® Xeon® Scalable Processors > Fine-tuning
Showcase BioGPT fine-tuning performance for PubMedQA dataset using HuggingFace API on distributed cloud native reference architecture on Dell PowerEdge R760 with Intel® 4th and 5th Gen Xeon® processors. The BioGPT model has the same architecture as GPT-2 model. The goal of the model is to generate a response given a question and the context. The base model is from HuggingFace repos, fine-tuned by using HuggingFace transformer AP.
BioGPT is a type of generative language model, trained on millions of previously published biomedical research articles. This means BioGPT can perform tasks such as answering questions, extracting relevant data, and generating text relevant to biomedical literature. It could empower biologists in various scenarios of scientific discovery.