Union.ai and Flyte: Privacy, Open Source, and Building a Commercial Business
Union is a powerful and flexible AI orchestration platform serving as the backbone of cutting-edge AI products. Founded by the co-creators of the hugely successful open-source project Flyte, Union.ai provides software users with the tools they need to move their ideas from concept to high-quality production. Union's aim is to organize the numerous processes required to train and grow the most sophisticated and dynamic machine learning and data products.
Flyte was experiencing a few challenges. For one, they had always been an open-source code base that promised backward compatibility for its users. In order to uphold that promise, they needed to maintain old versions of the code base forever. There was no way for them to know which, if any, of the old features and versions were even being used, so they couldn’t confidently deprecate them.
“We had one of the simple OSS problems where we didn't know what versions people were actively using,” said Haytham Abuelfutuh, co-author of Flyte and CTO at Union.ai.
Union was founded by the creators of Flyte. As a commercial business adding value to the open-source project, there was also the issue of not having a clear or complete picture of the project usage.
“We were sort of flying blind. We're hosting container images on GitHub. We get raw numbers of downloads a month; it didn’t quite tell us much. Zero visibility for our Helm charts,” added Haytham. “Only the most active users in the community had a say in what we did, including what versions or changes were important.”
Flyte is in the Linux Foundation and under the Apache 2 license. As open source advocates, the Flyte co-creators were sensitive to the community's reaction to them collecting any data.
“Using data from Scarf, we are able to send messages to the community warning people about certain versions that have a bug or a security issue,” said Haytham. “Knowing that somebody is still using it very actively and being able to warn them is very powerful.”
“It's actually hard to remember what we did before Scarf; it was one of the very first things we set up for tracking in Flyte,” said Haytham. “With Scarf, we know that people have stopped using version X, so we can safely deprecate it.”
Union.ai was a very early adopter of Scarf. The Flyte creators saw the value of usage analytics for the health of their community. For open source, they depend on Scarf for their analytics needs. They also have some basics for measuring web traffic and use Common Room to view all the signals together.
Union is an open source first company. It uses Scarf to drive their DevRel strategy and improve their open source project. It also uses Scarf to power its consultative sales approach to help customers where it makes sense.
Union has been successfully leveraging Scarf funnel analysis to shape the product to better fit the market so that they can focus on ensuring that companies can get value from Flyte sooner.
With the help of Scarf, Union realized that thousands of customers are using Flyte in production, and hundreds of them from fortune 2000 companies.
Published
June 6, 2024
This article was originally posted on
Hackernoon
Union is a powerful and flexible AI orchestration platform serving as the backbone of cutting-edge AI products. Founded by the co-creators of the hugely successful open-source project Flyte, Union.ai provides software users with the tools they need to move their ideas from concept to high-quality production. Union's aim is to organize the numerous processes required to train and grow the most sophisticated and dynamic machine learning and data products.
Flyte was experiencing a few challenges. For one, they had always been an open-source code base that promised backward compatibility for its users. In order to uphold that promise, they needed to maintain old versions of the code base forever. There was no way for them to know which, if any, of the old features and versions were even being used, so they couldn’t confidently deprecate them.
“We had one of the simple OSS problems where we didn't know what versions people were actively using,” said Haytham Abuelfutuh, co-author of Flyte and CTO at Union.ai.
Union was founded by the creators of Flyte. As a commercial business adding value to the open-source project, there was also the issue of not having a clear or complete picture of the project usage.
“We were sort of flying blind. We're hosting container images on GitHub. We get raw numbers of downloads a month; it didn’t quite tell us much. Zero visibility for our Helm charts,” added Haytham. “Only the most active users in the community had a say in what we did, including what versions or changes were important.”
Flyte is in the Linux Foundation and under the Apache 2 license. As open source advocates, the Flyte co-creators were sensitive to the community's reaction to them collecting any data.
“Using data from Scarf, we are able to send messages to the community warning people about certain versions that have a bug or a security issue,” said Haytham. “Knowing that somebody is still using it very actively and being able to warn them is very powerful.”
“It's actually hard to remember what we did before Scarf; it was one of the very first things we set up for tracking in Flyte,” said Haytham. “With Scarf, we know that people have stopped using version X, so we can safely deprecate it.”
Union.ai was a very early adopter of Scarf. The Flyte creators saw the value of usage analytics for the health of their community. For open source, they depend on Scarf for their analytics needs. They also have some basics for measuring web traffic and use Common Room to view all the signals together.
Union is an open source first company. It uses Scarf to drive their DevRel strategy and improve their open source project. It also uses Scarf to power its consultative sales approach to help customers where it makes sense.
Union has been successfully leveraging Scarf funnel analysis to shape the product to better fit the market so that they can focus on ensuring that companies can get value from Flyte sooner.
With the help of Scarf, Union realized that thousands of customers are using Flyte in production, and hundreds of them from fortune 2000 companies.
Tools and strategies modern teams need to help their companies grow.
.png)
.png)
.png)
.svg)
.svg)
.svg)
.svg)
Union is a powerful and flexible AI orchestration platform serving as the backbone of cutting-edge AI products. Founded by the co-creators of the hugely successful open-source project Flyte, Union.ai provides software users with the tools they need to move their ideas from concept to high-quality production. Union's aim is to organize the numerous processes required to train and grow the most sophisticated and dynamic machine learning and data products.
Flyte was experiencing a few challenges. For one, they had always been an open-source code base that promised backward compatibility for its users. In order to uphold that promise, they needed to maintain old versions of the code base forever. There was no way for them to know which, if any, of the old features and versions were even being used, so they couldn’t confidently deprecate them.
“We had one of the simple OSS problems where we didn't know what versions people were actively using,” said Haytham Abuelfutuh, co-author of Flyte and CTO at Union.ai.
Union was founded by the creators of Flyte. As a commercial business adding value to the open-source project, there was also the issue of not having a clear or complete picture of the project usage.
“We were sort of flying blind. We're hosting container images on GitHub. We get raw numbers of downloads a month; it didn’t quite tell us much. Zero visibility for our Helm charts,” added Haytham. “Only the most active users in the community had a say in what we did, including what versions or changes were important.”
Flyte is in the Linux Foundation and under the Apache 2 license. As open source advocates, the Flyte co-creators were sensitive to the community's reaction to them collecting any data.
“Using data from Scarf, we are able to send messages to the community warning people about certain versions that have a bug or a security issue,” said Haytham. “Knowing that somebody is still using it very actively and being able to warn them is very powerful.”
“It's actually hard to remember what we did before Scarf; it was one of the very first things we set up for tracking in Flyte,” said Haytham. “With Scarf, we know that people have stopped using version X, so we can safely deprecate it.”
Union.ai was a very early adopter of Scarf. The Flyte creators saw the value of usage analytics for the health of their community. For open source, they depend on Scarf for their analytics needs. They also have some basics for measuring web traffic and use Common Room to view all the signals together.
Union is an open source first company. It uses Scarf to drive their DevRel strategy and improve their open source project. It also uses Scarf to power its consultative sales approach to help customers where it makes sense.
Union has been successfully leveraging Scarf funnel analysis to shape the product to better fit the market so that they can focus on ensuring that companies can get value from Flyte sooner.
With the help of Scarf, Union realized that thousands of customers are using Flyte in production, and hundreds of them from fortune 2000 companies.
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)
.png)