https://beamstack.netlify.app/Recent content on BeamstackHugoenhttps://beamstack.netlify.app/docs/getting-started/introduction/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/getting-started/introduction/What is Beamstack? Beamstack is an open-source framework currently under development, aimed at facilitating the deployment of Machine Learning and GenAI workflow pipelines with Apache Beam on Kubernetes. Beamstack provides a robust Command Line Interface (CLI) that can potentially reduce pipeline deployment complexity and timelines drastically. It also possesses great monitoring and visualization features. Beamstack makes AI/ML on Kubernetes simple, portable, and scalable. Read the architecture overview to learn about the Beamstack ecosystem and to see how Beamstack components fit in ML lifecycle.https://beamstack.netlify.app/docs/getting-started/architecture/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/getting-started/architecture/This guide introduces Beamstack’s ecosystem and explains how it fits in the ML lifecycle. Read the introduction guide to learn more about Beamstack. Beamstack Ecosystem The following diagram gives an overview of the Beamstack Ecosystem and how it relates to the wider Kubernetes and AI/ML landscapes. How does Beamstack initilize components on a cluster? Beamstack pulls components directly from the registry using helm and kustomize and installs them on the kubernetes cluster.https://beamstack.netlify.app/docs/about/community/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/about/community/Beamstack is a community of users developing reusable components for GenAI and ML workflow to simplify and make it easy to deploy and manage ML workloads from easily composable low-code components Beamstack Discord Channels Come join us and make Beamstack better, we are looking for contributors to add components, review components and make it easy for users to get onboarded. Please join the Beamstack Discord. Click to join: Beamstack Slackhttps://beamstack.netlify.app/docs/concepts/features/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/concepts/features/This page introduces Beamstack’s features Read the introduction guide to learn more about Beamstack. Beamstack CLI Beamstack comes equipped with a robust Command-Line Interface (CLI) tool, providing users with a powerful method to install, deploy, and manage resources within the Beamstack ecosystem. With this CLI tool, users can seamlessly interact with the resources managed by Beamstack, enabling easy configuration and monitoring. AI Custom transforms Beamstack equips users with the ability to perfrom their own custom transforms and make inferences based on tasks performed.https://beamstack.netlify.app/tutorials/use_cases/initialization/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/use_cases/initialization/https://beamstack.netlify.app/tutorials/installation/installing-beamstack/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/installation/installing-beamstack/https://beamstack.netlify.app/docs/concepts/technical-concepts/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/concepts/technical-concepts/This guide introduces the technical concepts Beamstack was built upon. Abstraction Layers Beamstack acts as a low-code abstraction layer that allow users to deploy ML pipeline components with ease. This abstraction eliminates the need to modify SDK’s, making deployment accessible to both beginners and experienced users. Monitoring and Visualization Beamstack provides a monitoring stack consisting of Grafana and Prometheus that allows users to visualize the state of containers and resources within their pipelines.https://beamstack.netlify.app/docs/about/contributing/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/about/contributing/This document is the single source of truth for how to contribute to the code base. We’d love to accept your patches and contributions to this project. There are just a few small guidelines you need to follow. Joining the community Follow these instructions if you want to: Become a member of the Beamstack GitHub Org (see below) Become part of the Beamstack build teams or release teams Be recognized as an individual or organization contributing to Beamstack Joining the Beamstack GitHub Org First step is to join the discord channel In the join-beamstack channel, create a request to join the org Follow the prompts to get onboarded Contributing to the Beamstack Project There are a number of ways to contribute to Beamstack:https://beamstack.netlify.app/tutorials/use_cases/create_flink/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/use_cases/create_flink/https://beamstack.netlify.app/docs/about/contribution-guidelines/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/about/contribution-guidelines/We use Hugo to format and generate our website, the Docsy theme for styling and site structure, and Netlify to manage the deployment of the site. Hugo is an open-source static site generator that provides us with templates, content organisation in a standard directory structure, and a website generation engine. You write the pages in Markdown (or HTML if you want), and Hugo wraps them up into a website. All submissions, including submissions by project members, require review.https://beamstack.netlify.app/docs/getting-started/installing-beamstack/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/getting-started/installing-beamstack/This guide describes how to install Beamstack Command Line Interface (CLI) and all it’s components Read the introduction guide to learn more about Beamstack and its components. Installation Guide You can install Beamstack by following these steps. Navigate to the Beamstack Repository and download the latest release. Ensure you have chosen a binary that works for your operating system Open the downloaded package and install it. Once installed, to verfiy that Beamstack was succefully installed, run the following command in your terminal: beamstack -h You should see a list of available beamstack commands if installed properly.https://beamstack.netlify.app/tutorials/use_cases/open_flink/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/use_cases/open_flink/https://beamstack.netlify.app/tutorials/use_cases/open_dashboard/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/use_cases/open_dashboard/https://beamstack.netlify.app/tutorials/use_cases/deploy_pipeline/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/tutorials/use_cases/deploy_pipeline/ YAML pipeline: type: chain transforms: - type: Create config: elements: [1, 5, 2, 7, 3, 8, 10] - type: LogForTestinghttps://beamstack.netlify.app/blog/2024/08/15/easy-documentation-with-docsy/Thu, 15 Aug 2024 00:00:00 +0000https://beamstack.netlify.app/blog/2024/08/15/easy-documentation-with-docsy/This is a typical blog post that includes images. The front matter specifies the date of the blog post, its title, a short description that will be displayed on the blog landing page, and its author. Including images Here’s an image (featured-sunset-get.png) that includes a byline and a caption. Fetch and scale an image in the upcoming Hugo 0.43. Photo: Riona MacNamara / CC-BY-CA The front matter of this post specifies properties to be assigned to all image resources:https://beamstack.netlify.app/blog/2024/08/15/release-template/Thu, 15 Aug 2024 00:00:00 +0000https://beamstack.netlify.app/blog/2024/08/15/release-template/Text can be bold, italic, or strikethrough. Links should be blue with no underlines (unless hovered over). There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be whitespace between paragraphs. There should be no margin above this first sentence.https://beamstack.netlify.app/docs/getting-started/examples/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/docs/getting-started/examples/ To run the examples displayed here on your local computer, ensure beamstack in installed properly. Warning Ensure you have a cluster running before running any command Initialize a Kubernetes Cluster with Beamstack & Monitoring tools beamstack init -m Get the current kubernetes cluster context and profile info beamstack info Display the name, status and age of a cluster beamstack info cluster Create a runner cluster beamstack create [runner-cluster] [cluster-name] Open runner UI beamstack open [runner] [runner-cluster-name] Open Grafana dashboard beamstack open dashboard Deploy a pipeline beamstack deploy pipeline [FILE] [flags] Create a vector store beamstack create vector-store --type=elasticsearchhttps://beamstack.netlify.app/search/Mon, 01 Jan 0001 00:00:00 +0000https://beamstack.netlify.app/search/