medium-articles-notebooks's People
Forkers
joskid usmanmcgill rserran jcarlosrm hnt1807 itsshaikaslam vitonhosanto txkien02 walterignacio taltaf913 antarangsharma sumangeo kisiro55 anubhav10mishra mekongdelta-mind taner45 fdon ktellawi suacalis datastrategist winmills leevydanomalik zzdx713 glaceage roshani-d macdonkt giangbui techmum21p iamjaco bingxyu cajetanoriekezie damodaran013 ww166 andr6 skandh15 zeroxclem imdark eholmesnih abhinay01-rgb arturoferreiro sudhakso solomem james-wukong stevew00ds marvins56 saad20x puranjanp atdavidpark billibukun clic-ethiopia drmichaelwang elemi10 candidlpd nolll77 eichi7 ah-sabbir wahyudesu mangelaccio damodhar918 pjtacker ptzagk tfanme kencottrell deepaksethionly roysh merico34 echodreamer styner2023 alokproc rovast maheshdhingramedium-articles-notebooks's Issues
Index Error when fine tune the pretrained model
Index Error when fine tune the pretrained model with following notebook, do you know how to resolve the problem?
https://github.com/keitazoumana/Medium-Articles-Notebooks/blob/main/Train_your_LLM.ipynb
Train_your_LLM.ipynb: cannot import name 'prepare_model_for_int8_training' from 'peft'
According to https://github.com/huggingface/peft/issues/1583, prepare_model_for_int8_training has been replaced by prepare_model_for_kbit_training.
A process in the process pool was terminated abruptly while the future was running or pending.
Error: concurrent.futures.process.BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.
Expected Result: All images of the PDF to be outputted as images
What is happening: Whenever I run the code
`def convert_pdf_to_images(file_path, scale=300/72):
pdf_file = pdfium.PdfDocument(file_path)
page_indices = [i for i in range(len(pdf_file))]
renderer = pdf_file.render(
pdfium.PdfBitmap.to_pil,
page_indices = page_indices,
scale = scale,
)
final_images = []
for i, image in zip(page_indices, renderer):
image_byte_array = BytesIO()
image.save(image_byte_array, format='jpeg', optimize=True)
image_byte_array = image_byte_array.getvalue()
final_images.append(dict({i:image_byte_array}))
return final_images`
The code will not run and is giving this error.
` An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
if __name__ == '__main__':
freeze_support()
...
The "freeze_support()" line can be omitted if the program
is not going to be frozen to produce an executable.`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.