Examples
Generation Write an email to a customer when usage changes Evaluation (reading an incoming email) Assess if the customer is blocked or is reporting an urgent issue. Transformation Transform AI meeting notes into a post-meeting email to send to the customer Extraction Parse new contract details and input into Salesforce Enrichment Review interactions for the month and assign customer sentiment
Training: How LLMs Learn Language
Learning Patterns Through Probability: LLMs analyze massive datasets to understand the likelihood of word sequences based on how often they appear together. Distributions of Words: LLMs analyze word distributions to comprehend language patterns and relationships between words, and capture nuances like tone and style. Conditional Probability: LLMs adjust probabilities based on context, refining predictions to fit the situation. Learn More: Generative AI exists because of the transformer​ An Intuitive Guide to How LLMs Work
Training: The Data
Public forums and websites Open-source code 70,000+ books and research papers Data on the internet that requires authentication is not included. That includes paid subscriptions to news articles and private google documents and records
Inference: How LLMs Generate Text
Context Drives Coherence: LLMs consider the context provided by surrounding words Probabilities Predict: The model assigns probabilities to all possible next words based on previous words. Sampling for Variation: LLMs sample from the probability distribution, introducing variation and creativity.