Code Monkey home page Code Monkey logo

powerpointer-for-local-llms's Introduction

Hi 👋, I'm Timon Käch

Full stack developer and owner of CyberTimon

  • 🔭 I’m currently working on CT AI - An ai plattform which operates completely offline.

  • 🌱 I’m currently learning Machine Learning with PyTorch

  • 🚗 I created this racing game StylizedDrift

  • 📫 How to reach me [email protected]

  • ⚡ Fun fact 8B Parameters Are All You Need

Experience

  • Game Developer, (2019 - 2022)

    • Created a racing game called StylizedDrift using Unity.
    • Coded various game knock-off's like FallMönsch
    • Unreal Engine experience
    • Made 3D projects and games for friends
  • Web Development, (2020 - Present)

    • Learned Wordpress and made various sites with it
    • Experience in Flask and the frontend stack
    • Started with Python
    • Experience in ServiceNow and JavaScript
  • Hack Small Things, (Indefinite duration)

    • I love Hackintosh
    • Installed Minecraft on smartwatches
    • Decompiling software
    • Overclocking and modding graphics cards
  • Machine Learning Enthusiast, (2022 - Present)

    • Started getting interested in machine learning
    • Trained various image and text based AI models
    • Started coding my AI platform CT AI
    • Built myself a powerful home server
    • Contributed to Open Assistant (Contributors)
  • Computer Scientist, (Present)

    • Pursuing an apprenticeship.

Want to support me?

ko-fi

powerpointer-for-local-llms's People

Contributors

cybertimon avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

powerpointer-for-local-llms's Issues

to add new templates

"it's complicated to add new templates. I'm searching for an easier way". i want to add the new slide ,but i don't know how to do it If you know how to do it, please tell me

Index out of bound errors

Hi there,

First off, thank you for creating this...the potential I can see of it where I work is incredible!

However, I am seeing the same error frequently: File "/home/ec2-user/SageMaker/.cs/conda/envs/textgen/lib/python3.10/site-packages/transformers/models/gptj/modeling_gptj.py", line 223, in forward
sincos = torch.gather(embed_positions, 1, repeated_position_ids)
RuntimeError: index 2048 is out of bounds for dimension 1 with size 2048

I am running this on AWS Sagemaker on a CPU backed instance (yet to try on a GPU, but will later on) and following your example with AI as the topic I am always greeted with this error. Any ideas?! I am able to run the textegeneration API running ok (I think):

(textgen) [ec2-user@ip-10-10-1-139 text-generation-webui]$ python server.py --api --model eleutherai_gpt-j-6b --model-dir ../text-generation-webui/models/ --verbose --cpu --load-in-8bit
/home/ec2-user/SageMaker/.cs/conda/envs/textgen/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
INFO:Loading eleutherai_gpt-j-6b...
INFO:Loaded the model in 25.50 seconds.

Help?
Cheers,
Dan

ERROR

requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff4af6e6640>: Failed to establish a new connection: [Errno 111] Connection refused'))

Thank You!

Not an Issue, just wanted to say thank you for this! It's very easy to use and runs very well.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.