The GraphBLAS

Mike's Notes

 Alex found this. It might be useful. For future reference.

The original webpage has the links, and the graphic looks better.

Resources

References

  • Reference

Repository

  • Home > Ajabbi Research > Library >
  • Home > Handbook > 

Last Updated

05/01/2026

The GraphBLAS

By: 
GraphBlas: 5/01/2026

.

The GraphBLAS Forum is an open effort to define standard building blocks for graph algorithms in the language of linear algebra.

An example graph and adjacency matrix

We believe that the state of the art in constructing a large collection of graph algorithms in terms of linear algebraic operations is mature enough to support the emergence of a standard set of primitive building blocks. We believe that it is critical to move quickly and define such a standard, thereby freeing up researchers to innovate and diversify at the level of higher level algorithms and graph analytics applications. This effort was inspired by the Basic Linear Algebra Subprograms (BLAS) of dense Linear Algebra, and hence our working name for this standard is “the GraphBLAS”.

A key insight behind this work is that when a graph is represented by a sparse incidence or adjacency matrix, sparse matrix-vector multiplication is a step of breadth first search. By generalizing the pair of scalar operations involved in the linear algebra computations to define a semiring, we can extend the range of these primitives to support a wide range of parallel graph algorithms.

More information

  • The GraphBLAS Wikipedia Page
  • The C reference implementation is SuiteSparse:GraphBLAS, which implements the version 2.1.0 (final) C API.
  • Our 2013 manifesto for this project can be found here.
  • The mathematical definition of the GraphBLAS can be found here.
  • Background information about graphs in the language of linear algebra can be found in the book: Graph Algorithms in the Language of Linear Algebra, edited by J. Kepner and J. Gilbert, SIAM, 2011.
  • The Mathematics of Big Data by J. Kepner and H. Jananthan is the first book to present the common mathematical foundations of big data analysis across a range of applications and technologies.
  • A straw man proposal for the GraphBLAS can be found here
  • Gabor Szarnyas maintains a list of GraphBLAS pointers with lots of tutorial material.

Application Program Interface (API)

Current versions

  • GraphBLAS C API, version 2.0.0 (November 15, 2021)
  • GraphBLAS C API, version 2.1.0 (December 22, 2023)

Legacy versions

Version 1.0 (provisional) of the C language API was released on May 29, 2017 at the GABB workshop here. Version 1.1.0 (provisional) released on November 14, 2017. Version 1.2.0 was released on May 18, 2018. Version 1.3.0 was released on September 25, 2019.

Projects developing implementations of the GraphBLAS

  • SuiteSparse GraphBLAS (Texas A&M)
  • IBM GraphBLAS
  • GraphBLAS Template Library, GBTL (CMU-SEI/Indiana/PNNL)
  • GraphBLAST (UC Davis and LBNL)
  • MPI/C++ Combinatorial BLAS (CombBLAS)
  • Java Graphulo
  • Matlab/Octave D4M
  • GraphPad (Intel)

Programming Language Interfaces to The GraphBLAS API

  • MATLAB (comes with SuiteSparse). MATLAB R2021a and later uses SuiteSparse:GraphBLAS v3.1 for C=A*B when A and B are sparse. Release Notes, under Performance.
  • forGraphBLASGo - Go binding for SuiteSparse:GraphBLAS
  • pygraphblas Python library
  • python-graphblas Python library
  • pggraphblas Postgres extension
  • Julia library

Graph analysis systems that integrate GraphBLAS

  • FalkorDB - a queryable Property Graph database - formerly RedisGraph

Workshops and conferences featuring the GraphBLAS (reverse chronological)

  • Graphs, Architectures, Programming, and Learning (GrAPL) @IPDPS
  • High Performance Extreme Computing (HPEC)
  • GraphChallenge.org
  • SIAM CSE’21 GraphBLAS Minisymposium Session 1
  • SIAM CSE’21 GraphBLAS Minisymposium Session 2
  • SIAM CSE’21 GraphBLAS Tutorial Session 1
  • SIAM CSE’21 GraphBLAS Tutorial Session 2
  • HPEC 2020
  • HPEC 2019
  • HPEC 2018
  • GABB 2018 @IPDPS
  • HPEC 2017
  • GABB 2017 @IPDPS
  • HPEC 2016
  • GABB 2016 @IPDPS
  • HPEC 2015
  • GABB 2015 @IPDPS
  • HPEC 2014
  • GABB 2014 @IPDPS
  • HPEC 2013

Videos and other interesting discussions on GraphBLAS

  • GraphBLAS Forum Update at SC’25 (November 19, 2025)
  • GraphBLAS Forum Update at SC’22 (November 15, 2022)
  • Graph Analytics, by Tim Mattson and Henry Gabb, Intel
  • Short video description of GraphBLAS
  • HPEC’20 presentation on GraphBLAS in Python and MATLAB
  • Presentation at UT Austin
  • A good discussion thread on dropping explicit zeros (fall 2019)
  • A YouTube video playlist on GraphBLAS topics

GraphBLAS mailing list

If you wish to join our effort (or just watch it), please send an email message to our mailing list coordinator.

Steering Committee (alphabetical)

  • David Bader (NJIT)
  • Aydin Buluc (Berkeley Lab)
  • John Gilbert (UC Santa Barbara)
  • Jeremy Kepner (MIT Lincoln Laboratory Supercomputing Center)
  • Tim Mattson (Intel)
  • Henning Meyerhenke (KIT)

The GraphBLAS is supported by the following organizations


The GraphBLAS logo is licensed under CC BY 4.0 (designer: Jakab Rokob)

Vector Database vs Graph Database: Key Technical Differences

Mike's Notes

Pipi 9 uses graph databases and, so far, has no need for vector databases.

Resources

References

  • Reference

Repository

  • Home > Ajabbi Research > Library >
  • Home > Handbook > 

Last Updated

04/01/2026

Vector Database vs Graph Database: Key Technical Differences

By: Guy Korland
FalkorDB: 27/10/2024

Guy Korland serves as CEO at FalkorDB, where he drives graph database architecture for generative AI and retrieval-augmented generation workflows. He holds a PhD in Computer Science from Tel Aviv University and brings over 20 years of experience in database engineering. He previously led Redis’ incubation arm as SVP & CTO, oversaw platform architecture as GM & CTO at Stor.ai (Self-Point), co-founded and served as CTO of Shopetti, and directed R&D as VP at GigaSpaces.

Unstructured data is all the data that isn’t organized in a predefined format but is stored in its native form. Due to this lack of organization, it becomes more challenging to sort, extract, and analyze. More than 80% of all enterprise data is unstructured, and this number is growing.

This type of data comes from various sources such as emails, social media, customer reviews, support queries, or product descriptions, which businesses seek to extract meaningful insights from. The rapid growth of unstructured data presents both a challenge and an opportunity for businesses.

To extract insights from unstructured data, the modern approach involves leveraging large language models (LLMs) along with one of two powerful database systems for efficient data retrieval: vector databases or graph databases. These systems, combined with LLMs, enable organizations to structure, search, and analyze unstructured data. 

Understanding the difference between the two is crucial for developers looking to build modern AI applications or architectures like Retrieval-Augmented Generation (RAG). 

In this article, we dive deep into the concepts of vector databases and graph databases, exploring the key differences between them. We also examine their technical advantages, limitations, and use cases to help you make an informed decision when selecting your technology stack.

What is a Vector Database?

Vector databases excel at handling numerical representations of unstructured data — called embeddings — which are generated by machine learning models known as embedding models, unlike traditional databases that focus on structured data like rows and columns. These embeddings capture the semantic meaning (or, features) of the underlying data. Vector databases store, index, and retrieve data that has been transformed into these high-dimensional vectors or embeddings. 

You can convert any type of unstructured or higher-dimensional data into a vector embedding – text, image, audio, or even protein sequences – and this makes vector databases extremely flexible. When this data is converted into vector embeddings, the data points that are similar to each other are embedded closer in the embedding space. This allows for similarity (or, dissimilarity) searches, where you can find similar data using their corresponding vector representations. 

In that sense, vector databases are search engines designed to efficiently search through the higher dimensional vector space. 

For example, in a word embedding space, words with similar meanings or those that are often used in similar contexts would be closer together. The words “cat” and “kitten” would likely be near each other, while “automobile” would be farther away. In contrast, “automobile” might be close to words like “car” and “vehicle”.

The vector representation of these words might look like this:

"cat": [0.43, -0.22, 0.75, 0.12, ...]
"kitten": [0.41, -0.21, 0.76, 0.13, ...]
"automobile": [0.01, 0.62, -0.33, 0.94, ...]
"car": [0.02, 0.60, -0.30, 0.91, ...]

In this context, the vector representations of the words “cat” and “kitten” are closer to each other in the vector space due to their semantic similarity, while “automobile” and “car” would be farther from them but positioned closer to each other.

illustration of a vector representations of words

How does this help build retrieval systems in LLM-powered applications?

An example is a Vector RAG system, where a user’s query is first converted into a vector and then compared against the vector embeddings in the database of existing data. The vectors closest to the query vector are retrieved through a similarity search algorithm, along with the data they represent. This result data is then presented to the LLM to generate a response for the user.

Vector databases are valuable because they help uncover patterns and relationships between high-dimensional data points. 

However, they have a significant limitation: interpretability. The high-dimensional nature of vector spaces makes them difficult to visualize and understand. As a result, when a vector search yields incorrect or suboptimal results, it becomes challenging to diagnose and troubleshoot the underlying issues.

What is a Graph Database?

Graph databases work fundamentally differently from vector databases. 

Rather than using numerical embeddings to represent data, graph databases rely on knowledge graphs to capture the relationships between entities. 

In a knowledge graph, nodes represent entities, and edges represent the relationships between them. This structure allows for complex queries about relationships and connections, which is invaluable when the links between entities are as important as the entities themselves.

In the context of our earlier example involving “cat,” “kitten,” “automobile,” and “car,” each of these concepts would be stored as nodes in a knowledge graph. The relationship between “cat” and “kitten” (e.g., “is a type of”) would be represented as an edge connecting those two nodes. Similarly, “automobile” and “car” might have an edge representing a “synonym” relationship. This would capture the “subject”-“object”-“predicate” triples that form the backbone of knowledge graphs.

Nodes: "cat", "kitten", "automobile", "car"
Edges:
(kitten) -[: IS_A]-> (cat)
(automobile) -[: SYNONYM]-> (car)

Graph databases are ideal when your data contains a high degree of interconnectivity and where understanding these relationships is key to answering business questions. Also, unlike vector databases, knowledge graphs stored in a graph database can be easily visualized. This allows you to explore intricate relationships within your data. 

Modern graph databases support a query language known as Cypher, which allows you to query the knowledge graph and retrieve results. Let’s look at how Cypher works using the example of a slightly more complex knowledge graph.

knowledge graph flowchart of Barcelona FC and La Liga

To create the graph shown in the above image, you will need to construct the nodes and relationships that represent the different entities and their connections. You can use a graph database like FalkorDB to test the queries below. 

Here’s how we create the nodes:

// Creating Player nodes
CREATE (:PLAYER {name: 'Pedri'}), (:PLAYER {name: 'Lamine Yamal'});

// Creating Manager node
CREATE (:MANAGER {name: 'Hansi Flick'});

// Creating Team node
CREATE (:TEAM {name: 'Barcelona'});

// Creating League node
CREATE (:LEAGUE {name: 'La Liga'});

// Creating Country node
CREATE (:COUNTRY {name: 'Spain'});

// Creating Stadium node
CREATE (:STADIUM {name: 'Camp Nou'});

You can now create the relationships using Cypher in the following way: 

// Players play for a team
MATCH (p:PLAYER {name: 'Lamine Yamal'}), (t:TEAM {name: 'Barcelona'})
CREATE (p)-[:PLAYS_FOR]->(t);
MATCH (p:PLAYER {name: 'Pedri'}), (t:TEAM {name: 'Barcelona'})
CREATE (p)-[:PLAYS_FOR]->(t);

// Manager manages a team
MATCH (m:MANAGER {name: 'Hansi Flick'}), (t:TEAM {name: 'Barcelona'})
CREATE (m)-[:MANAGES]->(t);

// Team plays in a league
MATCH (t:TEAM {name: 'Barcelona'}), (l:LEAGUE {name: 'La Liga'})
CREATE (t)-[:PLAYS_IN]->(l);

// Team is based in a country
MATCH (t:TEAM {name: 'Barcelona'}), (c:COUNTRY {name: 'Spain'})
CREATE (t)-[:BASED_IN]->(c);

// Players have nationality
MATCH (p:PLAYER {name: 'Lamine Yamal'}), (c:COUNTRY {name: 'Spain'})
CREATE (p)-[:NATIONALITY]->(c);
MATCH (p:PLAYER {name: 'Pedri'}), (c:COUNTRY {name: 'Spain'})
CREATE (p)-[:NATIONALITY]->(c);

// Team's home stadium
MATCH (t:TEAM {name: 'Barcelona'}), (s:STADIUM {name: 'Camp Nou'})
CREATE (t)-[:HOME_STADIUM]->(s);

As you can see, Cypher queries are easily readable and self-explanatory. You can query the graph using the following example, where we search for players who play for Barcelona, along with their nationalities.

MATCH (p:PLAYER)-[:PLAYS_FOR]->(t:TEAM {name: 'Barcelona'})-[:BASED_IN]->(c:COUNTRY)
RETURN p.name AS Player, c.name AS Nationality;

Here’s the example output you will get: 

Player Nationality
Lamine Yamal Spain
Pedri Spain

Graph databases are purpose-built to efficiently store, query, and navigate complex knowledge graphs. Designed for handling large-scale knowledge graphs, they offer advanced search and querying capabilities. 

These databases are especially effective for applications requiring deep relationship analysis, such as GraphRAG systems, where knowledge graphs can be integrated with LLMs.

Key Differences between Vector Database and Graph Database

As we saw above, vector databases are optimized for similarity searches across high-dimensional data using vector embeddings generated by machine learning models. In contrast, graph databases are designed to model relationships between entities, making them ideal for tasks that require analyzing and understanding the connections between data points.

Here is a detailed breakdown of the key differences:

Feature Vector Database Graph Database
Data Model Represents data as vectors in a high-dimensional space. Represents data points as nodes (entities) connected by edges (relationships).
Query Capabilities Efficiently handles similarity search based on vector representations Effective for navigating & managing relationships. Involves graph traversal, subgraph matching, and shortest-path algorithms.
Performance Considerations Well-suited for large-scale, real-time similarity searches. Optimized for graph-based operations, such as network analysis and graph traversals.
Scalability Can scale horizontally to handle massive datasets and high-throughput queries. Scales with the number of data points. Can scale both horizontally and vertically to accommodate large graphs and complex queries. As it doesn’t have any schema, data can be easily added and modified. Scales with complexity and relationships of added data.
Indexing Vector databases rely heavily on ANN search for grouping the closest data points. Graph databases may use a combination of inverted indexes and graph-specific methods like adjacency matrix or GraphBLAS.


Key Similarities between Vector Database and Graph Database

Despite their differences in data representation and use cases, vector databases and graph databases share several core similarities, especially in how they support modern AI-driven applications and handle complex datasets. 

Both systems are designed to go beyond traditional relational databases, allowing developers to extract deeper insights from more complex and often unstructured data.

Here is a breakdown of their similarities.

Feature Vector Database Graph Database
Advanced Querying Capabilities Enables similarity search via Approximate Nearest Neighbor (ANN) algorithms. Allows relationship-based queries using traversal algorithms.
Handling Complex and Large Datasets Designed for large, high-dimensional datasets like embeddings. Optimized for complex, highly interconnected datasets with numerous relationships.
Optimized for Modern AI Applications Frequently used in AI/ML applications such as recommendation systems, semantic search, etc. Ideal for applications requiring knowledge representation.
Support for Low-Latency Queries Provides low-latency similarity search using efficient ANN algorithms. Optimized for real-time graph traversals and querying of relationships between entities.
Powering Recommendation and Search Systems Powers similarity-based recommendations and semantic search. Powers relationship-based recommendations and complex search queries.
Integration with AI Models Seamlessly integrates with AI models (e.g., LLMs) to transform data into vector embeddings, and also convert user queries into vectors for similarity search.

Seamlessly integrates with LLMs to transform data into knowledge graphs during ingestion, and convert natural language queries to Cypher during retrieval.


Vector Database vs Graph Database: Use Cases

When choosing between vector databases and graph databases, the decision largely depends on the nature of your data and the types of queries you need to perform. Below are key use cases for both, along with specific examples illustrating their advantages across various fields.

Fraud Detection

Graph Databases:

  • Graph databases are highly effective in fraud detection due to their ability to model complex relationships between entities such as users, transactions, accounts, and devices.
  • In financial systems, fraud often occurs within networks of interactions, where suspicious behavior is revealed through unusual patterns.
  • A graph database can analyze these relationships to identify potential fraud by traversing the network and detecting anomalies, such as unusual fund transfers or connections between seemingly unrelated accounts.
  • For instance, a query might explore the paths between accounts to uncover suspiciously interconnected transactions indicative of a money laundering scheme.

Vector Databases:

  • While vector databases are less commonly used for direct fraud detection, they can contribute by detecting anomalous behavior based on historical data patterns.
  • By embedding user behavior (e.g., browsing history, transaction patterns) as vectors, vector databases can identify instances where behavior deviates significantly from typical patterns through dissimilarity search. These deviations might suggest fraud and prompt further investigation.

Scientific Research

Graph Databases:

  • In scientific research, graph databases are invaluable for modeling complex systems where relationships between entities are critical.
  • For example, in biological research, entities like proteins, genes, and diseases are represented as nodes, while interactions between them (e.g., protein-protein interactions) are represented as edges.
  • Researchers can use graph traversal algorithms to uncover hidden connections between diseases and genetic markers, leading to new insights in genomics and drug discovery.
  • Knowledge graphs are also used in academic networks to trace citations and collaborations between researchers, identifying influential papers or emerging trends in a field.

Vector Databases:

  • Vector databases can also be applied in scientific research, particularly in fields like bioinformatics, where high-dimensional data such as DNA sequences or protein structures are common.
  • By converting these biological structures into vector embeddings, researchers can perform similarity searches to identify patterns in large datasets.
  • For instance, vector databases can be used to compare protein structures, searching for similar sequences across vast biological datasets to identify evolutionary relationships or potential drug targets.

eCommerce

Graph Databases

  • In ecommerce, graph databases are highly effective for recommendation systems and customer journey analysis.
  • By modeling the relationships between customers, products, and transactions, ecommerce platforms can generate personalized recommendations by traversing the graph to find connections between users with similar purchasing histories or interests.
  • Additionally, graph databases can track inventory, supplier relationships, and logistics, optimizing the entire supply chain by analyzing relationships across the network.

Vector Databases

  • Vector databases enhance ecommerce applications by enabling personalized recommendations based on user behavior and product similarities.
  • By converting user interactions (e.g., clicks, purchases) and product descriptions into vector embeddings, ecommerce platforms can use vector databases to identify products similar to those users have interacted with.
  • This technique is widely used in product recommendation engines, where users are presented with items similar to their previous searches or purchases, boosting engagement and conversion rates.

Media and Entertainment

Graph Databases

  • The media and entertainment industry benefits from graph databases by modeling content recommendation networks and social relationships.
  • For example, streaming platforms like Netflix and Spotify use graph databases to map user preferences, social connections, and content relationships (e.g., actors, genres, directors).
  • These platforms can then traverse the graph to recommend new movies or songs based on the preferences of similar users or related content. Additionally, graph databases can manage complex relationships between media assets (e.g., episodes, seasons, franchises) and their metadata.

Vector Databases

  • In media and entertainment, vector databases enable content-based search and recommendation systems by using vector embeddings for media content.
  • For instance, a vector database can store embeddings of movies, TV shows, or songs, capturing their semantic features.
  • Users can search for media by uploading images, audio, or even descriptions, and the vector database will return content that is semantically similar.
  • In applications like music discovery, vector databases help recommend songs with similar audio features, while in video search, they enable finding visually similar content based on user preferences or searches.

structure of a knowledge graph

How to Choose between Vector Database and Graph Database

Choosing between a vector database and a graph database depends on several key factors, including the nature of your data, your application’s requirements, and how you intend to query and use the data. 

Below are the most important considerations to guide your decision-making process:

Understand Your Data

The first step in choosing between a vector or graph database is understanding the type of data you are working with.

  • Vector Database: If your data is high-dimensional, such as images, multilingual text, audio, or video, then a vector database is a better fit. For instance, if you are working with embeddings from image recognition models, a vector database allows you to store these vectors and efficiently perform similarity searches between them.
  • Graph Database: If your data is knowledge-oriented and the relationships between entities are of primary importance, then a graph database is the right choice. For example, if you are modeling social networks, supply chains, or recommendation systems, where the relationships between entities (nodes) drive your queries and insights, graph databases are optimized for these scenarios.

Performance and Scalability Needs

Both vector and graph databases are designed to scale, but they have to be managed differently as the dataset grows.

Vector Database: Vector databases excel in low-latency searches even with millions of vectors. Techniques like Approximate Nearest Neighbor (ANN) algorithms ensure that similarity searches can be performed in near real-time, making them ideal for large-scale AI/ML applications. If your application requires fast retrieval of items based on vector similarity, and you expect the dataset to grow continuously, vector databases are optimized for this.

Graph Database: Graph databases, while scalable, face more challenges with performance as the graph becomes more interconnected and deeper. If your application requires complex, multi-hop queries across deeply connected data, you will need to ensure your graph database can handle the load. However, for applications that involve exploring relationships (e.g., shortest paths, friend-of-a-friend queries), graph databases offer performance advantages over relational models. Be mindful that as the graph grows, advanced partitioning and optimization strategies may be needed to maintain performance. In such scenarios, you should consider a graph database known for its low latency and scalability.

Evaluate the Specific Advantages of Each Technology

Weigh the advantages and trade-offs of each database based on the technical requirements of your application.

Graph Database: If relationship analysis and graph traversal are core to your application, then graph databases are unmatched in their ability to model and query complex, interrelated data. The flexibility to modify schema on the fly and the power to model rich, interconnected data make graph databases the best choice for knowledge-centric applications.

Vector Database: Offers clear advantages for AI-powered applications that rely on embeddings. However, they lack interpretability and are not ideal for applications that require understanding relationships between data points.

An Integrated Solution with FalkorDB

FalkorDB is a low-latency graph database graph with select vector capabilities. It offers high-speed performance for both graph traversals and vector similarity searches. 

Some key features of FalkorDB include:

  1. Integrated Data Management: FalkorDB’s unified structure allows for concurrent storage and querying of graph relationships and vector embeddings. This integration eliminates the need for multiple specialized databases, simplifying data architectures.
  2. Advanced Query Processing: The system employs algorithms to optimize queries that involve both graph connections and vector similarities.
  3. Robust Scalability: FalkorDB maintains rapid response times even as data volumes expand, making it suitable for evolving data needs and streaming data.
  4. Streamlined Operations: By combining graph and vector functionalities, FalkorDB reduces the complexity associated with managing and synchronizing separate database systems.

This approach offers a compelling solution for organizations seeking to leverage both semantic relationships and vector-based similarity in their data operations, all within a single, powerful platform.

Knowledge Graph Ecosystem

Additionally, FalkorDB comes with an ecosystem of tools that simplify the process of building applications that derive insights from unstructured data. Here are some: 

GraphRAG-SDK

  • This SDK is designed to simplify the creation of Graph Retrieval-Augmented Generation (GraphRAG) systems. It integrates with FalkorDB and LLMs like OpenAI’s GPT and Google’s Gemini. It enables developers to build knowledge graphs from unstructured data and query them using LLM-generated Cypher queries.
  • The SDK is particularly useful for building AI systems that require reasoning over complex data relationships, such as in finance, legal, or healthcare domains.

FalkorDB-Browser

  • This tool is a visualization interface for exploring and managing graph data stored in FalkorDB. It allows users to interactively navigate through nodes and edges, facilitating data exploration in large knowledge graphs.
  • The browser is ideal for users who need to visually understand the structure of their data or monitor real-time changes in a dynamic graph system​

FalkorDB CodeGraph

  • This tool transforms a codebase into a knowledge graph that visualizes relationships between different code entities like classes, functions, and variables.
  • By analyzing the structure of the code, developers can gain insights into dependencies, detect bottlenecks, and optimize software projects.

Knowledge Graph Ecosystem

Based on the detailed walkthrough above, you now have a comprehensive understanding of vector databases and graph databases. This knowledge equips you to choose the most suitable database type for your project, depending on your specific data structures and query requirements. 

To get started, here are the links to the documentation, cloud platform, and community channels of FalkorDB.

How Science Actually Uses Machine Learning in 2025

Mike's Notes

A great summary of ML resources other than Generative AI. It was published in the Turing Post newsletter. The Turing Post is worth subscribing to.

Resources

References

  • Reference

Repository

  • Home > Ajabbi Research > Library > Subscriptions > Turing Post
  • Home > Handbook > 

Last Updated

213/01/2026

How Science Actually Uses Machine Learning in 2025

By: Marktechpost
Turing Post: 18/12/2025

In this guest post, Marktechpost shares findings from the ML Global Impact Report 2025, an interactive research landscape now available at airesearchtrends.com. Based on an analysis of 5,000+ papers from Nature journals, the report shows that while the world obsesses over generative AI, classical methods still dominate real scientific research.

In fact, 77% of machine learning applications in science rely on traditional techniques like Random Forest, XGBoost, and CatBoost, not transformers or diffusion models. The gap between AI headlines and what actually runs in labs is much larger than most people realize.

State of current media

If you open any tech newsletter or media house, you’ll be convinced that science runs on GPT-4, diffusion models, and whatever architecture dropped last week.

What we found looks very different.

When we analyzed over 5,000 scientific articles published in Nature family journals between January and September 2025, a different picture emerged entirely.

Classical ML methods, like Random Forest, support vector machines (SVMs), and Scikit-learn workflows, account for 47% of all ML use cases in scientific research.

Moreover, adding established ensemble methods like XGBoost, LightGBM, and CatBoost, and traditional approaches, represents a dominant 77% of how scientists actually deploy ML models today.

But for neural networks and deep learning, it’s roughly 23%.

This has nothing to do with slow adoption but rather how research teams put forward their research.

In practice, researchers prioritize methods they can clearly justify during peer review. Novelty matters, but only after reliability, interpretability, and dataset sanity checks are satisfied. A Random Forest that reliably predicts protein binding affinity beats a transformer that might work better but introduces unpredictable failure modes.

When a paper depends on reproducibility and collaborators need to understand every step, novelty quickly becomes a liability. And in that context, reliability matters more than novelty.

For practitioners, the risk is obvious. Optimizing your stack around what trends on AI Twitter actively pulls you away from the methods that dominate real scientific workflows.

But who creates the tools versus who uses them?

The most consequential imbalance in ML research is who builds the tools versus who publishes with them. Nearly 90% of open-source ML tools referenced in 2025 scientific literature originate from the United States, where the foundational frameworks are powering imaging, genomics, and environmental science worldwide.

Yet the heaviest users aren’t American. China accounts for 43% of all ML-enabled papers in our dataset, compared to just 18% from the United States.

India holds third place and is climbing fast.

This imbalance shapes who sets research agendas and who executes them. Essentially, American institutions and companies build the infrastructure, while Chinese researchers publish the papers.

That said, non-US contributions to the tooling ecosystem are significant and growing. For instance:

  • Scikit-learn emerged from France.
  • U-Net, the workhorse of medical image segmentation, came from Germany.
  • CatBoost was developed in Russia by Yandex.
  • Canada produced foundational GAN and RNN architectures.

The US still dominates this layer of the stack, but it is not the only contributor.

What does this mean for the AI research community? The countries that define the frameworks shape how problems get formulated. When you inherit someone else’s tools, you often inherit their assumptions about what problems matter and how they should be solved.

Applied sciences and health research lead adoption

ML hasn’t penetrated all scientific fields equally. The heaviest adoption appears in applied sciences and health research, which are disciplines where prediction, classification, and pattern recognition map cleanly onto existing workflows.

Consider the specific applications we observed across thousands of papers:

  • In medical sciences, ML enables early-detection imaging, precision diagnostics, genomic sequence mapping, and mutation tracking. Cancer screening pipelines now routinely incorporate ensemble classifiers. Biomarker discovery increasingly depends on feature extraction from high-dimensional datasets.
  • In physical and materials sciences, researchers apply ML to advanced robotics, materials engineering, and complex physical simulations. Nanotechnology labs use neural networks to predict material properties before synthesis, saving months of experimental iteration.
  • In environmental sciences, large-scale Earth-observation analytics rely on ML for everything from monsoon prediction to disaster preparedness. Climate models incorporate machine learning components for pattern recognition in satellite imagery. Remote sensing has been transformed.
  • In agriculture, crop-yield forecasting and food systems resilience modeling now depend on ML pipelines trained on decades of historical data.

In most papers, ML appears as one step in an experimental pipeline, not the object of study.

In most domains, ML is not the focus of the paper itself. Instead, researchers publish papers about cancer or climate or crop yields that happen to use machine learning as methodology, showcasing that ML has transitioned from the research subject to the research infrastructure used in downstream problem-solving.

Collaborative research is predominant!

Contributions from the research community and our analysis make it clear that the lone genius scientist is a myth.

Most ML-enabled papers in our dataset include 2-15 institutional affiliations. Major studies rarely originate from a single organization.

But collaboration patterns differ dramatically by region.

To put this into figures:

  • American papers average 4.1 organizations per study, reflecting a highly distributed ecosystem spanning universities, hospitals, national laboratories, and private research institutions. Harvard Medical School leads in ML-enabled research volume, but the broader US landscape is remarkably decentralized.
  • Chinese papers average 2.6 organizations per study, indicating a more concentrated, high-throughput model where fewer institutions produce more output. China achieves its 43% global share through density rather than breadth, with 72.8 articles per university compared to 39.6 in the US.
  • Lastly, new collaboration corridors are emerging. India, Saudi Arabia, and the United States increasingly partner on applied sciences, materials research, engineering, and computer vision.

For AI practitioners building research relationships, these patterns matter. A collaboration strategy that works in the American context (distributed, multi-institutional) may need adjustment for Chinese partnerships (concentrated, institution-centric).

India’s quiet rise to third place

The report’s third-largest contributor doesn’t get enough attention: India has achieved a steep upward trajectory in ML-driven scientific output, now ranking behind only China and the United States.

What makes India’s approach distinctive is its focus on practical, scalable innovation rather than hype-driven experimentation. Indian ML research concentrates on socially relevant applications, like health diagnostics, climate resilience, fraud detection, agricultural optimization, and materials science, with local relevance.

Participation is broadening beyond elite institutions. Tier 1 and Tier 2 universities now contribute meaningfully to India’s ML research ecosystem, and a rapidly growing startup landscape is translating academic research into applied research and output.

For organizations looking to build global research partnerships, India represents an increasingly attractive option: strong technical talent, growing institutional capacity, and a pragmatic orientation toward problems that matter.

What this means for your ML strategy?

The gap discussed above mostly creates confusion, especially for practitioners who mistake visibility for impact.

If you are a researcher, don’t let trend-chasing distract from methodology that works. If Random Forest solves your problem, publish with confidence. The Nature portfolio clearly agrees.

If you are a practitioner, the tools that matter for production systems, like ensemble methods, classical feature engineering, and interpretable models, remain the tools that matter for scientific research. Investment in boring ML capabilities pays compounding returns.

If you are an ML organization, Geographic asymmetries in tool development versus research output suggest strategic opportunities. Countries consuming US-built frameworks may eventually develop alternatives.

If you are an investor or policymaker, the classical-vs-generative distribution should inform research priorities. Generative AI captures headlines, but traditional ML delivers the bulk of scientific impact.

ML is the infra layer of modern science

The takeaway is straightforward. Machine learning has stopped being the subject of research and has become the machinery behind it.

Scientists don’t write papers about Random Forest any more than they write papers about healthcare, for instance. They write papers about what Random Forest helped them discover.

As Asif Razzaq, Editor and Co-Founder of Marktechpost, put it: 

“This report shows that machine learning isn’t just reshaping AI, it’s reshaping science itself. The real story here is not hype, but impact, which tells that ML is now a fundamental instrument of modern scientific work.”

The 77% figure should humble anyone convinced that transformers and diffusion models define the field.

The geographic asymmetries should interest anyone thinking about how power flows through technical ecosystems. And the collaboration patterns should inform anyone building research networks in an increasingly multipolar scientific landscape.

The full interactive data is available at airesearchtrends.com, where you can explore country-level breakdowns, disciplinary distributions, and tool-by-tool analysis across 125+ countries and 5,000+ papers.

The next time someone tells you AI research is all about the latest foundation model, you’ll have 5,000 data points suggesting otherwise.

Thanks for reading!

This post was written by the Marktechpost team, specifically for Turing Post. We thank Marktechpost for sharing the ML Global Impact Report 2025 findings and supporting Turing Post’s mission to cut through the froth.

Machine Learning Systems

Mike's Notes

I discovered this list of free learning resources by reading Rohit Kumar Tiwari's Substack. The teachers are excellent. This is a compilation of his Substack posts.

  • Machine Learning Systems book (Harvard)
  • CS336: Language Modelling from Scratch (Stanford)
  • CS229: Machine Learning (Stanford)
  • CS295: Transformers & LLMs (Stanford)
  • 6.S087: Foundation models and generative AI (MIT)
  • Learn to Build AI Agents (Microsoft Developer)

Resources

References

  • Reference

Repository

  • Home > Ajabbi Research > Library >
  • Home > Handbook > 

Last Updated

2/01/2026

Machine Learning Systems

By: Rohit Kumar Tiwari
Awesome Neuron: 24/12/2025

Simplifying AI for Everyone | Sr. Data Scientist | A Decade of Experience | Creator of AwesomeNeuron | Top 1% @Topmate | Writes to 16K+ @LinkedIn | GenAI, LLMs, Agents.

Harvard University

Machine Learning Systems

A free book by Prof Vijay Janapa Reddi (PDF)

Stanford University

CS336: Language Modelling from Scratch

17 Videos. Language models serve as the cornerstone of modern natural language processing (NLP) applications and open up a new paradigm of having a single general purpose system address a range of downstream tasks. As the field of artificial intelligence (AI), machine learning (ML), and NLP continues to grow, possessing a deep understanding of language models becomes essential for scientists and engineers alike. This course is designed to provide students with a comprehensive understanding of language models by walking them through the entire process of developing their own. Drawing inspiration from operating systems courses that create an entire operating system from scratch, we will lead students through every aspect of language model creation, including data collection and cleansing for pre-training, transformer model construction, model training, and evaluation before deployment.

CS229: Machine Learning

The fastest way I know to really understand AI.

Stanford CS229. Free. 20 lectures.

Course taught by legendary Andrew Ng.

CS295: Transformers & LLMs

These 9 lectures from Stanford are a pure goldmine for anyone wanting to understand LLMs in depth.

MIT

6.S0087: Foundation Models and Generative AI

MIT literally packed 7 hours with everything you need to know about GenAI for FREE.

Microsoft Developer

Learn to Build AI Agents

13 videos. Just 2 hours. Free on YouTube.

Chips Huyen MLOps guide

Mike's Notes

I was mesmerised by Chips's talks, which explained MLOps very clearly. Here is a copy of her resources page. The original page has many links. A fantastic resource.

"MLOps (Machine Learning Operations) is a set of practices combining Machine Learning, DevOps, and Data Engineering to automate, standardize, and manage the end-to-end lifecycle of ML models. It aims to increase automation (CI/CD) for faster, reliable deployment, while maintaining model performance and monitoring for drift." - Databricks

Resources

References

  • Reference

Repository

  • Home > Ajabbi Research > Library >
  • Home > Handbook > 

Last Updated

30/03/2026

Chips Huyen MLOPs guide

By: Chips Huyen
Chip Huyen: 11/01/2025

I’m Chip Huyen, a writer and computer scientist. I grew up chasing grasshoppers in a small rice-farming village in Vietnam.

My focus is on ML/AI systems in production. I’m currently exploring creative use cases of AI in education and entertainment.

Previously, I worked on ML tooling at NVIDIA (core dev of NeMo), Snorkel AI, and Netflix. I also founded and sold an AI infra startup.

Running a startup taught me that being a founder is incredibly hard, so I try to support founders in any way I can. Some startups I’ve worked with included Convai, OctoAI, and Photoroom.

I graduated from Stanford, where I taught ML Systems. The lectures became the foundation for the book Designing Machine Learning Systems, which is an Amazon #1 bestseller in AI and has been translated into 10+ languages (very proud)!

My new book AI Engineering (2025) is currently the most read book on the O’Reilly platform. It’s also available on Amazon and Kindle.

I’m active on GitHub and aspire to become a Goodreads influencer. You can also find me on Google Scholar. I frequently speak at and occasionally host events.

I enjoy learning about fun technical challenges and collaborating with great teams. Reach out if you want to find a way to work together!.

Update (Jan 11, 2025): I’m working on a minimum viable curriculum for ML/AI engineering. Here’s the interest form if you want to test out the curriculum.

A collection of materials from introductory to advanced. This is roughly the path I’d follow if I were to start my MLOps journey again.

Table of contents

  • ML + engineering fundamentals
  • MLOps
  • …. Overview
  • …. Intermediate
  • …. Advanced
  • Career
  • Case studies
  • Bonus

ML + engineering fundamentals

While it’s tempting to want to get straight to ChatGPT, it’s important to have a good grasp of machine learning, deep learning, NLP, and reinforcement learning fundamentals.

  • 10 free ML courses: make sure to take those classes in order.
  • [Book] Machine Learning: A Probabilistic Perspective (Kevin P. Murphy). A draft PDF link can be found here.
  • [Book] Information Theory, Inference, and Learning Algorithms (David MacKay). Free online version here.
  • [Book] Deep Learning (Ian Goodfellow, Yoshua Bengio, and Aaron Courville). Free online version.
  • [Book] Introduction to Information Retrieval (Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze). Essential for anyone interested in Natural Language Processing. Free online version.
  • [Book] Reinforcement Learning: An Introduction (Richard S. Sutton and Andrew G. Barto). Essential for reinforcement learning. Free online version.
  • [Tutorials] OpenAI’s Spinning up in Deep Reinforcement Learning: A collection of articles that give great intuition for many RL algorithms. Highly recommended for anyone interested in RL.
  • [Video] Andrej Karpathy’s Zero to Hero series
  • Tools and concepts I’d prioritize learning
  • A survivor’s guide to AI courses at Stanford (Updated Feb 2020)

MLOps

What’s MLOps?

Ops in MLOps comes from DevOps, short for Developments and Operations. To operationalize something means to bring it into production, which includes deploying, monitoring, and maintaining it.

Currently, this section contains a lot of my writing, certainly because of my bias and because when I set out to learn about MLOps, there wasn’t a lot of resources about it yet. I’ll add more materials soon!

  • [Book] Designing Machine Learning Systems (O’Reilly, 2022)
  • [Community] Some of the best discussions I have had are on our MLOps Discord server [15k+ members]. You’re welcome to ask questions and join us in our monthly talks/discussions!

Overview

Overview of ML in production.

  • [Video] Machine learning production myths (Stanford’s MLSys Seminars)
  • [Lecture note] Introduction to machine learning in production
  • Rules of Machine Learning: Best Practices for ML Engineering (Martin Zinkevich, 2019)
  • What I learned from looking at 200 machine learning tools [Jun 2020]
  • Machine Learning Tools Landscape v2 (+84 new tools) [Dec 2020]
  • The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction (Breck et al., 2017)
  • Building LLM applications for production

Intermediate

Deep dives into different aspects of ML production.

  • [Lecture note] Creating training data: sampling, labeling, handling class imbalance, data augmentation
  • [Lecture note] Feature engineering
  • [Book excerpt] Data Distribution Shifts and Monitoring
  • Instrumentation, Observability & Monitoring of Machine Learning Models (Josh Wills, 2019)
  • RLHF: Reinforcement Learning from Human Feedback

Advanced

Build the best MLOps platform for your organization!

  • Real-time machine learning: challenges and solutions
  • [Lecture note] Data system fundamentals for data scientists
  • A friendly introduction to machine learning compilers and optimizers
  • Why data scientists shouldn’t need to know Kubernetes
  • Self-serve feature platforms: architectures and APIs

Career

  • [Free book] Machine Learning Interviews Book
  • [Twitter thread] The ML interviews process
  • Career advice for recent Computer Science graduates
  • Four lessons I learned after my first full-time job after college
  • 7 reasons not to join a startup and 1 reason to
  • Analysis of compensation, level, and experience details of 19k tech workers
  • What Glassdoor interview reviews reveal about tech hiring cultures
  • What we look for in a resume

Case studies

To get a sense of the challenges of machine learning production, it’s helpful to learn from companies who are doing it.

  1. Using Machine Learning to Predict Value of Homes On Airbnb (Robert Chang, Airbnb Engineering & Data Science, 2017)

    In this detailed and well-written blog post, Chang described how Airbnb used machine learning to predict an important business metric: the value of homes on Airbnb. It walks you through the entire workflow: feature engineering, model selection, prototyping, moving prototypes to production. It’s completed with lessons learned, tools used, and code snippets too.

  2. Using Machine Learning to Improve Streaming Quality at Netflix (Chaitanya Ekanadham, Netflix Technology Blog, 2018)

    As of 2018, Netflix streams to over 117M members worldwide, half of those living outside the US. This blog post describes some of their technical challenges and how they use machine learning to overcome these challenges, including to predict the network quality, detect device anomaly, and allocate resources for predictive caching.
    To understand Netflix’s infrastructure for machine learning, check out Ville Tuulos’s talk Human-Centric Machine Learning Infrastructure @Netflix.

  3. 150 Successful Machine Learning Models: 6 Lessons Learned at Booking.com (Bernardi et al., KDD, 2019)

    As of 2019, Booking.com has around 150 machine learning models in production. These models solve a wide range of prediction problems (e.g. predicting users’ travel preferences and how many people they travel with) and optimization problems (e.g.optimizing the background images and reviews to show for each user). Adrian Colyer gave a good summary of the six lessons learned here:
    • Machine learned models deliver strong business value.
    • Model performance is not the same as business performance.
    • Be clear about the problem you’re trying to solve.
    • Prediction serving latency matters.
    • Get early feedback on model quality.
    • Test the business impact of your models using randomized controlled trials.

  4. Machine Learning-Powered Search Ranking of Airbnb Experiences (Mihajlo Grbovic, Airbnb Engineering & Data Science, 2019)

    This article walks you step by step through a canonical example of the ranking and recommendation problem. The four main steps are system design, personalization, online scoring, and business aspect. The article explains which features to use, how to collect data and label it, why they chose Gradient Boosted Decision Tree, which testing metrics to use, what heuristics to take into account while ranking results, how to do A/B testing during deployment. Another wonderful thing about this post is that it also covers personalization to rank results differently for different users.

  5. From shallow to deep learning in fraud (Hao Yi Ong, Lyft Engineering, 2018)

    Fraud detection is one of the earliest use cases of machine learning in the industry. This article explores the evolution of fraud detection algorithms used at Lyft. At first, an algorithm as simple as logistic regression with engineered features was enough to catch most fraud cases. Its simplicity allowed the team to understand the importance of different features. Later, when fraud techniques have become too sophisticated, more complex models are required. This article explores the tradeoff between complexity and interpretability, performance and ease of deployment.

  6. Space, Time and Groceries (Jeremy Stanley, Tech at Instacart, 2017)

    Instacart uses machine learning to solve the task of path optimization: how to most efficiently assign tasks for multiple shoppers and find the optimal paths for them. The article explains the entire process of system design, from framing the problem, collecting data, algorithm and metric selection, topped with a tutorial for beautiful visualization.

  7. Creating a Modern OCR Pipeline Using Computer Vision and Deep Learning (Brad Neuberg, Dropbox Engineering, 2017)

    An application as simple as a document scanner has two distinct components: optical character recognition and word detector. Each requires its own production pipeline, and the end-to-end system requires additional steps for training and tuning. This article also goes into detail the team’s effort to collect data, which includes building their own data annotation platform.

  8. Scaling Machine Learning at Uber with Michelangelo (Jeremy Hermann and Mike Del Balso, Uber Engineering, 2019)

    Uber uses extensive machine learning in their production, and this article gives an impressive overview of their end-to-end workflow, where machine learning is being applied at Uber, and how their teams are organized.

  9. How we grew from 0 to 4 million women on our fashion app, with a vertical machine learning approach (Gabriel Aldamiz, HackerNoon, 2018)

    To offer automated outfit advice, Chicisimo tried to qualify people’s fashion taste using machine learning. Due to the ambiguous nature of the task, the biggest challenges are framing the problem and collecting the data for it, both challenges are addressed by the article. It also covers the problem that every consumer app struggles with: user retention.

Bonus

Some stuff I did that don’t quite fit into any section above, but I want to share anyway :P

  • [Code] Python-is-cool: Cool Python features that I used to be too afraid to use
  • [Code] just-pandas-things: Pandas quirks that used to traumatize me
  • [Code] Coding exercises and solutions for coding interviews
  • [Video] Switching From a Batch to Streaming Mindset w/ Chip Huyen
  • [VentureBeat] 4 AI and ML job hunting tips from Chip Huyen
  • [Booklet] Machine learning systems design (2019): My initial notes on ML systems back. This 8000-word booklet gave ideas for the book Designing Machine Learning Systems in 2022.