Home > Workload Solutions > Data Analytics > White Papers > GenAI on Dell APEX File Storage for AWS using Databricks, Hugging Face, and MosaicML > Step 4: Fine-tune the pretrained LLM models
Import the Hugging Face transformer library and select the model and tokenizer.
1. OpenAI GPT
OpenAI GPT: Import GPT Model and Tokenizer.
OpenAI GPT: Tokenize the text data, train, optimize, and save the fine-tuned model and tokenizer in Dell APEX File Storage.
OpenAI GPT: Verify that the fine-tuned model and tokenizer have been saved into Dell APEX File storage.
2. Google BERT
Google Bert: Import BERT Model and Tokenizer
Google Bert: Tokenize the text data, train, optimize, and save the fine-tuned model and tokenizer in Dell APEX File Storage.
Google Bert: Verify that the fine-tuned model and tokenizer have been saved in Dell APEX File Storage.
3. Falcon
Falcon: Import Falcon Model and Tokenizer
Falcon: Tokenize the text data, train, optimize, and save the fine-tuned model and tokenizer in Dell APEX File Storage.
Falcon: Verify that the fine-tuned model and tokenizer have been saved in Dell APEX File Storage.