svpino / alloy-voice-assistant Goto Github PK

Python 100.00%

alloy-voice-assistant's Introduction

Hey! 👋

My name is Santiago, and I'm a Computer Scientist focusing on applied Machine Learning. I have more than two decades of experience building software to solve exciting and —sometimes— hard problems.

I care deeply about unlocking the power of technology for individuals and businesses, so they can use computers in a way that was previously unrealistic for them. I find joy in ambiguity and feel more engaged when working on problems that can't be solved by merely searching the web or reading a book. Bonus points if I can collaborate with a team of like-minded engineers!

This is where I've worked during the last 10 years

DIRECTOR OF COMPUTER VISION SOLUTIONS

Levatas. Oct 2018 - Present

I lead a small team of software developers and machine learning engineers in the development of Levatas' flagship product, a platform to augment the productization of machine learning models with human reviews, where I'm the main contributor to the core Python engine. Other than that, the majority of my work centers around building solutions to help operationalize machine learning models running on AWS.

DIRECTOR OF ENGINEERING | ENGINEER MANAGER | SENIOR SOFTWARE ENGINEER

Levatas. Oct 2010 – Oct 2018.

I joined Levatas in 2010 as a Senior Software Engineer, moved to Engineer Manager three years later, before becoming the director of the department in May 2016. During this time, I had the opportunity to help deliver software solutions for companies like IBM, Dell, and HSBC. I moved through the entire development stack and touched projects every step of the way, from ideation to final delivery.

My education

MASTER OF SCIENCE (M.Sc.), COMPUTER SCIENCE

Machine Learning Specialization. Georgia Institute of Technology, 2019. 4.0 GPA

I was a Teaching Assistant of Graduate Algorithms during two semesters. Coursework: Software Architecture and Design, Software Development Process, Algorithms, Software Testing, Machine Learning, Reinforcement Learning, Database Systems, Computer Vision, Human-Computer Interaction.

BACHELOR OF SCIENCE (B.S.), INFORMATION TECHNOLOGY

University of Camaguey, Cuba. 2004. 3.84 GPA

Coursework: Software Engineering, Data Structures and Algorithms, Database Design, File Structures, Artificial Intelligence, Information Technology.

OTHER CERTIFICATIONS

I've also accumulated other certifications from 2001 to 2015 covering OO Concepts, Java, C, JavaScript, and C# development.

My most relevant technical skills

These are the highlights of the skills I consider to be the keystone of my abilities:

I have a lot of experience designing and architecting systems of different sizes and complexity.
I've become an excellent Python 🐍 developer. And this happened after years dedicated to Java.
I have a lot of experience with Machine Learning using TensorFlow.
I have been focusing mainly on AWS. It's the place where most of my work goes to serve its purpose.
I have substantial experience dealing with relational databases (mainly MySQL), and non-relational ones (Amazon's DynamoDB, Google's Firestore, and MongoDB.)
I've done a lot of front-end development, and at some point, I was pretty good using Angular.

Some of the things I've built

It's hard to decide what things should make it into this list, so I'm opting for a combination of private and public projects where I've participated over the last ten years.

A Python library that orchestrates a workflow of images between different services deployed in AWS.
An application that connects to Spot's cameras, and makes the robot react to visual clues.
A process using OpenCV and TensorFlow to analyze a video feed and flag break-ins into an amusement park.
A library to generate RSS 2.0 feeds in Python.
A project to run TensorFlow Object Detection models on SageMaker.
A very simple and fully responsive file system-based blog engine.
Some really cool and interesting projects during my Masters that have become popular solutions to their respective problems.
A full Android application to follow stock tickers from different markets worldwide.

Other accomplishments

I love to write. I contribute articles about Python to the Real Python website.
I won a bunch of medals competing nationally on Computer Science. Since that time I've loved algorithms and data structures
I have a beautiful family. For sure my best accomplishment by far.

📫 You can find me on Twitter or LinkedIn.

alloy-voice-assistant's People

Contributors

Stargazers

Watchers

Forkers

shaneholloman caio-swdev allengodswill nozh selftaughtcoder78704 bushidosunny srikantjyrmn styner2023 iainatdbi orion89 syedtahirhussan picenipedro javiervicho rebots-online alonsoir guyresh lalroshan590 manish-genai professeurfalken chrisn-au sasesh humanely pop2pop3 roysh nithyaa12 natural20ai eworkforce ishaqahmad41455 thompsonson cpapazaf tomchapin primedeviation phillipgimmi cironunez bryansparks lluisagusti vital121 ay1ncode kromian hbcbh1999 emilio-gagliardi odeyale2016 marcus20232023 teawavesurfer cosmopax davmixcool emilgaripov kielrn bxck75 keval-b archytus10 tranquyetdev joshua-shepherd hirendave47 adrianorighi ivoneysilva 0minary jrick166fiap luscafusca felipemarques gtellapolinario costarotela codeberserkers888 ribeiro yago-ribeiro-dev rderakhshan mojowebs miguelsalcedo01 rafoyer davtechsupport chidi21 wildownes ricardovcore mikeybeez thembahank frankwengerek rpcoelho23 kemeny arnie936 esyeng daniel-ddv olimiemma lilwonga paulcutcliffe oilik he-huang-1982 edwardshez sim-says malpern shiv19 sitais mgm79 aaroncwacker jeunjetta

alloy-voice-assistant's Issues

Audio does not work.

Hi ,

First of great project and thanks for making this public. I was trying to run it locally. Upon successful installation of the python packages, the CAM opened up. But then there is an error:

Exception in thread Thread-2 (threaded_listen):
Traceback (most recent call last):
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 1344, in do_open
h.request(req.get_method(), req.selector, req.data, headers,
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1319, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1365, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1314, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1074, in _send_output
self.send(msg)
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1018, in send
self.connect()
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/http/client.py", line 1460, in connect
self.sock = self._context.wrap_socket(self.sock,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/ssl.py", line 455, in wrap_socket
return self.sslsocket_class._create(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/ssl.py", line 1046, in _create
self.do_handshake()
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/ssl.py", line 1317, in do_handshake
self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1000)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/threading.py", line 1052, in _bootstrap_inner
self.run()
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/threading.py", line 989, in run
self._target(*self._args, **self._kwargs)
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/site-packages/speech_recognition/init.py", line 568, in threaded_listen
if running[0]: callback(self, audio)
^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/Documents/work/ai_projects/video_assistant/assistant.py", line 150, in audio_callback
prompt = recognizer.recognize_whisper(audio, model="base", language="english")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/site-packages/speech_recognition/init.py", line 1412, in recognize_whisper
self.whisper_model[model] = whisper.load_model(model, **load_options or {})
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/site-packages/whisper/init.py", line 133, in load_model
checkpoint_file = _download(_MODELS[name], download_root, in_memory)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/site-packages/whisper/init.py", line 69, in _download
with urllib.request.urlopen(url) as source, open(download_target, "wb") as output:
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 215, in urlopen
return opener.open(url, data, timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 515, in open
response = self._open(req, data)
^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 532, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 492, in _call_chain
result = func(*args)
^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 1392, in https_open
return self.do_open(http.client.HTTPSConnection, req,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jaydeep.chakrabarty/anaconda3/envs/v_conda_cam/lib/python3.12/urllib/request.py", line 1347, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1000)>

Any idea?

hey i am new to this

Hello,
I am new to coding, have some patience with me.

i followed your steps and get this error, can somebody help me, i changed nothing on your Assistant.py file
i have a .env file with an open.ai api.
i installed all req. python libs

This is my output in widows:

Traceback (most recent call last):
File "C:\assistant\assistant.py", line 8, in
from langchain.prompts import ChatPromptTemplate, MessagesPlaceholder
File "D:\Python\Lib\site-packages\langchain\prompts_init_.py", line 32, in
from langchain_core.example_selectors import (
File "D:\Python\Lib\site-packages\langchain_core\example_selectors_init_.py", line 6, in
from langchain_core.example_selectors.length_based import (
File "D:\Python\Lib\site-packages\langchain_core\example_selectors\length_based.py", line 6, in
from langchain_core.prompts.prompt import PromptTemplate
File "D:\Python\Lib\site-packages\langchain_core\prompts_init_.py", line 27, in
from langchain_core.prompts.base import (
File "D:\Python\Lib\site-packages\langchain_core\prompts\base.py", line 22, in
from langchain_core.output_parsers.base import BaseOutputParser
File "D:\Python\Lib\site-packages\langchain_core\output_parsers_init_.py", line 15, in
from langchain_core.output_parsers.base import (
File "D:\Python\Lib\site-packages\langchain_core\output_parsers\base.py", line 18, in
from langchain_core.language_models import LanguageModelOutput
File "D:\Python\Lib\site-packages\langchain_core\language_models_init_.py", line 25, in
from langchain_core.language_models.base import (
File "D:\Python\Lib\site-packages\langchain_core\language_models\base.py", line 75, in
class BaseLanguageModel(
File "D:\Python\Lib\site-packages\pydantic\v1\main.py", line 286, in new
cls.try_update_forward_refs()
File "D:\Python\Lib\site-packages\pydantic\v1\main.py", line 807, in try_update_forward_refs
update_model_forward_refs(cls, cls.fields.values(), cls.config.json_encoders, localns, (NameError,))
File "D:\Python\Lib\site-packages\pydantic\v1\typing.py", line 554, in update_model_forward_refs
update_field_forward_refs(f, globalns=globalns, localns=localns)
File "D:\Python\Lib\site-packages\pydantic\v1\typing.py", line 520, in update_field_forward_refs
field.type_ = evaluate_forwardref(field.type_, globalns, localns or None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\Python\Lib\site-packages\pydantic\v1\typing.py", line 66, in evaluate_forwardref
return cast(Any, type_)._evaluate(globalns, localns, set())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: ForwardRef._evaluate() missing 1 required keyword-only argument: 'recursive_guard'

so, yeah, i would be glad if you can provide help

Need setup tools for Python 3.12

I needed to install setuptools for this to work with Python 3.12.

python3 -m pip install setuptools

Video is black on Mac - solved

Machine Apple M2 Max
OS Sonoma Version 14.5

Amazing work - I was very pleasantly surprised when I got it working. I did struggle a little with the fact that when I started the app the video was black. A bit of googling later found the problem to be

def __init__(self):
        self.stream = VideoCapture(index=1)
        _, self.frame = self.stream.read()
        self.running = False
        self.lock = Lock()

When I changed the index from 0 to 1 it just worked. Do you want a PR on the README or are you happy to do it.

My test today was to get it to help me make a cup of tea. the future is not far away - amazing

svpino / alloy-voice-assistant Goto Github PK

alloy-voice-assistant's Introduction

Hey! 👋

This is where I've worked during the last 10 years

My education

My most relevant technical skills

Some of the things I've built

Other accomplishments

alloy-voice-assistant's People

Contributors

Stargazers

Watchers

Forkers

alloy-voice-assistant's Issues

Audio does not work.

hey i am new to this

Need setup tools for Python 3.12

Video is black on Mac - solved

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent