Engines

An engine is a complete text-to-code and code-to-video generation system for Generative Manim (GM). Since there are many ways we can think about video generation, we developed multiple engines so that they can be evaluated with LangSmith.

• GM powered by DSL
• GM powered by LangGraph
• GM OpenAI Fine-tuned
• GM OpenAI GPT-4 with Few-Shot Learning
• GM OpenAI GPT-4 with Zero-Shot Learning
• GM OpenAI GPT-4 with Ontologies/RAG

Anyone can suggest a new way (workflow, method, technique) to generate videos.

Platforms

API

Generative Manim will be available with a REST API.

• Create /code-to-video endpoint (Ready)
• Create /text-to-code endpoint (To be enhanced)
  • Add an option to switch between different GM engines (e.g. DSL, Ontologies, etc.)
  • Add first model (the simplest one, using GPT-4 with few-shot training and zero shot learning)

LangChain Integration

• Create a package over LangChain?

GPT / Chatbot

• OpenAPI YAML file with API endpoints

Streamlit

• New OpenAI API Key
• Integrate new system to detect possible errors on Streamlit

Testing

• Define how to test the results of GM engines, in order to choose the best. From the best engine that makes the best result, to the best engine with the lowest usage of tokens.

Note that GPT4 costs 3 (input) to 6 (generated) cents for 1000 tokens, so you actually get more like 1 million tokens for $30.

Reference: https://openai.com/pricing

Your app is good and to some extent, brilliant.
However, it seems Streamlit starts rendering having only received partial code, and not the complete code for an animation.
This obviously, cause the animation not to render.
Here try this for example:
swing a double pendulum

Hello macky.

These days I am thinking about how to make a more general path of text -> mainm code -> video.
Since the gpt code and weights are not open, I plan to train a model by myself.
We can work together if you want.

Hello macky.

I have a problem. I have entered my openai API, and remain report the following: Error: We couldn't generate the generated code. Please reload the page, or try again later.

Could you help me, thanks a lot.