Learn Databricks GenAI

• This is the repository for the LinkedIn Learning course Learn Databricks GenAI.
• Mirror Repo for this course at this link. Please see the README in that repo for more info.

Course Description

In this detailed course, cloud architect and experienced technical educator Lynn Langit explores Generative AI with Databricks. Discover how to use prompt engineering in Databricks AI and BI to effectively query data with AI prompts. Learn to implement and set up Vector Search to enhance your GenAI applications. Understand the Retrieval-Augmented Generation (RAG) pattern and its integration to boost your AI projects with your data. Get hands-on with model tuning, including foundation model training and fine-tuning with Hugging Face transformers. Gain the skills you need to harness AI for data queries, implement advanced search techniques, and fine-tune AI models. This course empowers you to unlock the power of Databricks and elevate your data-driven decision-making capabilities.

📁 Notebooks Folder Structure and Usage

The notebooks folder in this repository is organized into subfolders corresponding to sections from the course. Each subfolder contains links to notebooks named after the links provided in the respective section. These examples serve as references or starting points for exploring the topics mentioned in the links. Here's how to navigate and use the links to the notebooks:

• Vector Search in Databricks: Contains notebooks related to understanding and creating vector search indexes in Databricks.
• RAG-Pattern in Databricks: Includes notebooks that explain the Retrieval-Augmented Generation (RAG) pattern in Databricks.
• Model Tuning in Databricks: Features notebooks for understanding Hugging Face Transformers, fine-tuning models, and foundation model training in Databricks.

To use these notebooks, navigate to the corresponding subfolder and select the link to the notebook that matches your interest. Each notebook link includes a comment linking back to the original documentation page for further reading and context.

Instructor

Lynn Langit

Cloud Architect

Check out my other courses on LinkedIn Learning.