Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Sentiment Analysis using Dell APEX File Storage for AWS and Amazon SageMaker
Executive summary Solution Architecture Solution Overview Solution Validation
Solution Validation
Step 1: Amazon SageMaker Studio
Step 2: Setup and import the IMDB dataset
Step 3: Create the Training, Testing, and Validation sets
Step 4: Select the BERT preprocessing module
Step 5: Pass data to the preprocessing module and BERT
Step 6: Pass data to the preprocessing module and BERT
Step 7: Training and Evaluation
Step 8: Saving and Re-loading the model.
Step 9: Predictions
Conclusion References

Step 2: Setup and import the IMDB dataset

Home > APEX > Storage > White Papers > Sentiment Analysis using Dell APEX File Storage for AWS and Amazon SageMaker > Step 2: Setup and import the IMDB dataset

Step 2: Setup and import the IMDB dataset

  • Download the data to use for the analysis. In this example, we will download the data directly to Dell APEX File storage.

    To process the textual information, we require the following libraries:

    And the following imports:

    Next, we will create a folder to mount the Dell APEX File Storage share, and download the dataset to it. We also delete any unused folders to make it easier to load the data.