Skip to content

Latest commit

Β 

History

History
606 lines (498 loc) Β· 35.7 KB

File metadata and controls

606 lines (498 loc) Β· 35.7 KB

AI Resource Hub

This document provides a curated collection of high-quality resources for learning about AI, data science, and related topics from respected experts, researchers, and institutions. Resources are organised by topic, format, and expertise level for easy navigation.

This document provides a curated list of high-quality sources for learning about AI, data science, and related topics. These sources come from respected experts, researchers, and institutions, making them reliable and informative references. πŸ“š indicates an authoritative reference source.

Table of Contents

How to Use This Hub

This resource hub uses several navigation aids to help you quickly find relevant resources:

  • By Topic: Find resources organised by subject area
  • By Format: Browse resources by content type (books, courses, etc.)
  • By Expertise Level: Filter resources by difficulty
  • Tag Index: Find resources by specific topics or technologies

Each resource includes standardised metadata:

  • Type: πŸ“• Book | πŸŽ“ Course | πŸ“„ Article | πŸ“Ή Talk | πŸ“° Newsletter | πŸ” Research | πŸ‘€ Person
  • Level: 🟒 Beginner | 🟑 Intermediate | πŸ”΄ Advanced
  • Tags: Keywords for cross-referencing
  • Description: Brief explanation of the resource's content and value

Featured Resources

A selection of foundational resources that provide great value:

  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #deep-learning #practical #hands-on #fastai
  • Description: A rich, practice-oriented course that teaches how to apply deep learning to practical problems, complemented by the Fastbook.
  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #llm #software-development #agents #evaluation #best-practices
  • Description: Teaches how to build LLM-powered software reliably, from first principles, covering the entire GenAI software development lifecycle.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #llm #product-development #lessons-learned #applied-ai
  • Description: Practical guide to building successful LLM products, covering tactical, operational, and strategic considerations, complemented by podcast episodes 29 and 30.
  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #llm #agents #foundation-models #task-automation
  • Description: Comprehensive course discussing fundamental concepts for LLM agents, including LLM foundations, essential abilities for task automation, and agent development infrastructure.
  • Type: πŸ” Research
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #data-visualisation #global-issues #research #evidence-based
  • Description: Project from the University of Oxford providing data-driven insights into global issues, valuable for understanding the world's largest problems and potential solutions.

By Topic

Foundations of AI and ML

Machine Learning Fundamentals

  • Type: πŸ“• Book πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #machine-learning #supervised-learning #science #best-practices
  • Description: Explores the role of supervised machine learning in scientific research with philosophical justifications and integration best practices.

Algorithms and Optimisation

  • Type: πŸ“• Book πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #algorithms #optimisation #metaheuristics #stochastic
  • Description: Open lecture notes on metaheuristic algorithms, covering stochastic optimisation methods intended as alternatives to brute-force search.

Large Language Models

Development and Applications

  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #genai #product-development #foundation-models #implementation
  • Description: Comprehensive guide laying out the foundations for building products with Generative AI.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #llm #ollama #on-premise #privacy #function-calling #agents
  • Description: Demonstrates how to run LLMs on-premise to maintain data privacy and control of your tech stack, with clear Python code examples.

Agents

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #agents #llm #anthropic #agentic-workflow #alignment
  • Description: Research paper exploring robust AI agent design, presenting agentic workflow approaches, alignment methods, and techniques for autonomous, reliable tasks.

Structured Outputs

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #structured-output #llm #function-calling #parsing #json
  • Description: Provides various solutions for achieving structured output from LLMs when function calling or specific response formats become challenging.

Vector Representations

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #embeddings #vector-representations #nlp #semantic-search
  • Description: Comprehensive article exploring the concept of embeddings, their applications, and how they work in modern AI systems.

AI Engineering

Evaluation and Testing

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #evaluation #ai-testing #product-development #quality-assessment
  • Description: Structured, comprehensive resource on how to construct domain-specific evaluation systems for AI products.

Data Pipelines

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #data-flywheel #llm #logging #evaluation #continuous-improvement
  • Description: Breaks down how to improve AI systems iteratively through logging, evaluation, and continuous refinement processes.

MLOps

  • Type: πŸ“„ Article
  • Level: 🟒 Beginner
  • Tags: #mlops #devops #data-centric #production-systems
  • Description: Explains how machine learning operations differ from traditional DevOps due to ML's direct exposure to messy real-world data.

Data Science

Data Analysis

  • Type: πŸ” Research
  • Level: 🟑 Intermediate
  • Tags: #ai-engineering #papers #llm #benchmarks #prompting #rag #agents #code-generation
  • Description: Curated list of 50 papers/models/blogs across 10 fields in AI Engineering, providing a solid foundation for understanding current research directions.

Ethics and Responsible AI

Perspectives from experts in this area include researchers focused on ethical AI development:

  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #ai-ethics #complex-systems #computational-intelligence
  • Description: Respected professor of computer science and prominent figure in complex systems and artificial intelligence, offering valuable perspectives on AI challenges.

Technical Skills

Presentations

  • Type: πŸ“Ή Talk
  • Level: 🟒 Beginner
  • Tags: #presentations #communication #slides #public-speaking
  • Description: Collection of excellent presentations on how to present effectively.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner
  • Tags: #powerpoint #presentations #communication #visual-thinking
  • Description: A book about PowerPoint built out of PowerPoint, covering communication techniques, culture, and effective presentation approaches.

GPU Programming

  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #gpu-programming #cuda #flash-attention #triton #quantisation
  • Description: Channel with excellent material on GPU programming, including CUDA kernels, Flash Attention, Triton, and quantisation techniques.

By Format

Books

  • Type: πŸ“• Book πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #machine-learning #supervised-learning #science #best-practices
  • Description: Explores the role of supervised machine learning in scientific research with philosophical justifications and integration best practices.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #algorithms #optimisation #metaheuristics #stochastic
  • Description: Open lecture notes on metaheuristic algorithms, covering stochastic optimisation methods intended as alternatives to brute-force search.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #llm #ollama #on-premise #privacy #function-calling #agents
  • Description: Demonstrates how to run LLMs on-premise to maintain data privacy and control of your tech stack, with clear Python code examples.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #genai #product-development #foundation-models #implementation
  • Description: Comprehensive guide laying out the foundations for building products with Generative AI.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner
  • Tags: #powerpoint #presentations #communication #visual-thinking
  • Description: A book about PowerPoint built out of PowerPoint, covering communication techniques, culture, and effective presentation approaches.

Courses

  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #deep-learning #practical #hands-on #fastai
  • Description: A rich, practice-oriented course that teaches how to apply deep learning to practical problems, complemented by the Fastbook.
  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #llm #software-development #agents #evaluation #best-practices
  • Description: Teaches how to build LLM-powered software reliably, from first principles, covering the entire GenAI software development lifecycle.
  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #llm #agents #foundation-models #task-automation
  • Description: Comprehensive course discussing fundamental concepts for LLM agents, including LLM foundations, essential abilities for task automation, and agent development infrastructure.

Articles

  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #evaluation #ai-testing #product-development #quality-assessment
  • Description: Structured, comprehensive resource on how to construct domain-specific evaluation systems for AI products.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #data-flywheel #llm #logging #evaluation #continuous-improvement
  • Description: Breaks down how to improve AI systems iteratively through logging, evaluation, and continuous refinement processes.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #llm #product-development #lessons-learned #applied-ai
  • Description: Practical guide to building successful LLM products, covering tactical, operational, and strategic considerations, complemented by podcast episodes 29 and 30.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #agents #llm #anthropic #agentic-workflow #alignment
  • Description: Research paper exploring robust AI agent design, presenting agentic workflow approaches, alignment methods, and techniques for autonomous, reliable tasks.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #embeddings #vector-representations #nlp #semantic-search
  • Description: Comprehensive article exploring the concept of embeddings, their applications, and how they work in modern AI systems.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #structured-output #llm #function-calling #parsing #json
  • Description: Provides various solutions for achieving structured output from LLMs when function calling or specific response formats become challenging.
  • Type: πŸ“„ Article
  • Level: 🟒 Beginner
  • Tags: #mlops #devops #data-centric #production-systems
  • Description: Explains how machine learning operations differ from traditional DevOps due to ML's direct exposure to messy real-world data.

Talks and Presentations

  • Type: πŸ“Ή Talk
  • Level: 🟒 Beginner
  • Tags: #presentations #communication #slides #public-speaking
  • Description: Collection of excellent presentations on how to present effectively.
  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate
  • Tags: #engineering-leadership #tech-solutions #workplace-politics #egoless-engineering
  • Description: Insightful talks on egoless engineering, straightforward tech solutions, and workplace politics from an engineering leadership perspective.
  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #hacking #reverse-engineering #security #technical-exploration
  • Description: Vast collection of presentations by the Chaos Computer Club, covering reverse engineering, cutting-edge exploration, and authentic engineering concepts.
  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #gpu-programming #cuda #flash-attention #triton #quantisation
  • Description: Channel with excellent material on GPU programming, including CUDA kernels, Flash Attention, Triton, and quantisation techniques.

Newsletters

  • Type: πŸ“° Newsletter
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #ai-news #trends #research #development
  • Description: Daily newsletter summarising top discussions in AI-focused online communities, covering latest trends, research, and developments.
  • Type: πŸ“° Newsletter
  • Level: 🟒 Beginner
  • Tags: #ai-education #machine-learning #accessible-explanations
  • Description: Newsletter by Professor Tom Yeh providing insights and educational content with accessible explanations of AI concepts.

Research Resources

  • Type: πŸ” Research
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #research-assistant #arxiv #computer-science #trending-papers
  • Description: AI research assistant that synthesises the latest computer science research from arXiv and surfaces trending pre-prints.
  • Type: πŸ” Research
  • Level: 🟑 Intermediate
  • Tags: #ai-engineering #papers #llm #benchmarks #prompting #rag #agents #code-generation
  • Description: Curated list of 50 papers/models/blogs across 10 fields in AI Engineering, providing a solid foundation for understanding current research directions.
  • Type: πŸ” Research
  • Level: 🟒 Beginner to 🟑 Intermediate
  • Tags: #data-visualisation #global-issues #research #evidence-based
  • Description: Project from the University of Oxford providing data-driven insights into global issues, valuable for understanding the world's largest problems and potential solutions.

Social Media

  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate
  • Tags: #healthcare #medical-ai #future-medicine #technology
  • Description: Renowned cardiologist, scientist, and author who has written extensively on the future of medicine, including AI and digital technologies impact.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #data-science #fastai #deep-learning #ai-education
  • Description: Prominent data scientist, co-founder of fast.ai and answer.ai, providing educational content and research insights in data science.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate
  • Tags: #data-science #ai-ethics #ai-education #mathematics
  • Description: Data scientist, educator, ethics advocate who co-founded fast.ai and directed USF's Center for Applied Data Ethics, recognised as one of Forbes' 20 Incredible Women in AI.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #ai-research #deep-learning #tesla #openai
  • Description: Leading AI researcher and educator, former Director of AI at Tesla and founding team member at OpenAI, providing in-depth insights on AI advancements.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate
  • Tags: #open-source #datasette #django #data-tools
  • Description: Independent open-source developer and data leader, creator of Datasette and co-creator of Django, with significant contributions to open-source community.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #ai-ethics #complex-systems #computational-intelligence
  • Description: Respected professor of computer science and prominent figure in complex systems and artificial intelligence, offering valuable perspectives on AI challenges.
  • Type: πŸ‘€ Person
  • Level: πŸ”΄ Advanced
  • Tags: #machine-learning #bayesian-optimisation #battery-modeling #quantum-devices
  • Description: Professor of machine learning focused on Bayesian optimisation and applications in battery modeling and quantum devices, creator of Bluesky starter packs for prominent figures.
  • Type: πŸ‘€ Person
  • Level: 🟑 Intermediate
  • Tags: #statistics #ml-interpretability #uncertainty-quantification #mindful-modeler
  • Description: Statistician and ML expert specialising in interpretability and uncertainty quantification, author of books on interpretable ML and modeling mindsets.

By Expertise Level

Beginner

  • Type: πŸ“Ή Talk
  • Level: 🟒 Beginner
  • Tags: #presentations #communication #slides #public-speaking
  • Description: Collection of excellent presentations on how to present effectively.
  • Type: πŸ“• Book πŸ“š
  • Level: 🟒 Beginner
  • Tags: #powerpoint #presentations #communication #visual-thinking
  • Description: A book about PowerPoint built out of PowerPoint, covering communication techniques, culture, and effective presentation approaches.
  • Type: πŸ“„ Article
  • Level: 🟒 Beginner
  • Tags: #mlops #devops #data-centric #production-systems
  • Description: Explains how machine learning operations differ from traditional DevOps due to ML's direct exposure to messy real-world data.
  • Type: πŸ“° Newsletter
  • Level: 🟒 Beginner
  • Tags: #ai-education #machine-learning #accessible-explanations
  • Description: Newsletter by Professor Tom Yeh providing insights and educational content with accessible explanations of AI concepts.

Intermediate

  • Type: πŸ“• Book πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #machine-learning #supervised-learning #science #best-practices
  • Description: Explores the role of supervised machine learning in scientific research with philosophical justifications and integration best practices.
  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #llm #software-development #agents #evaluation #best-practices
  • Description: Teaches how to build LLM-powered software reliably, from first principles, covering the entire GenAI software development lifecycle.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate
  • Tags: #evaluation #ai-testing #product-development #quality-assessment
  • Description: Structured, comprehensive resource on how to construct domain-specific evaluation systems for AI products.
  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate
  • Tags: #engineering-leadership #tech-solutions #workplace-politics #egoless-engineering
  • Description: Insightful talks on egoless engineering, straightforward tech solutions, and workplace politics from an engineering leadership perspective.

Advanced

  • Type: πŸŽ“ Course πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #llm #agents #foundation-models #task-automation
  • Description: Comprehensive course discussing fundamental concepts for LLM agents, including LLM foundations, essential abilities for task automation, and agent development infrastructure.
  • Type: πŸ“„ Article πŸ“š
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #agents #llm #anthropic #agentic-workflow #alignment
  • Description: Research paper exploring robust AI agent design, presenting agentic workflow approaches, alignment methods, and techniques for autonomous, reliable tasks.
  • Type: πŸ“Ή Talk
  • Level: 🟑 Intermediate to πŸ”΄ Advanced
  • Tags: #gpu-programming #cuda #flash-attention #triton #quantisation
  • Description: Channel with excellent material on GPU programming, including CUDA kernels, Flash Attention, Triton, and quantisation techniques.
  • Type: πŸ‘€ Person
  • Level: πŸ”΄ Advanced
  • Tags: #machine-learning #bayesian-optimisation #battery-modeling #quantum-devices
  • Description: Professor of machine learning focused on Bayesian optimisation and applications in battery modeling and quantum devices, creator of Bluesky starter packs for prominent figures.

Tag Index