Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updated the library/module versions in the requirements.txt file and also updated a few typos in the code. #149

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Updated the library/module versions in the requirements.txt file and also updated a few typos in the code. #149

wants to merge 5 commits into from

Conversation

vignesh1507
Copy link

previously:

aiosqlite==0.20.0
html2text==2024.2.26
lxml==5.3.0
litellm==1.48.0
numpy>=1.26.0,<2.1.1
pillow==10.4.0
playwright==1.47.0
python-dotenv==1.0.1
requests>=2.26.0,<2.32.3
beautifulsoup4==4.12.3

After updation:

aiosqlite==0.20.0
html2text==2024.2.26
lxml==5.3.3
litellm==1.49.0
numpy>=1.26.0,<2.1.1
pillow==10.4.0
playwright==1.50.0
python-dotenv==1.0.1
requests>=2.26.0,<2.31.0
beautifulsoup4==4.12.4

@vignesh1507
Update web_crawler.py
1677967
@vignesh1507
Update utils.py
7a41308
@vignesh1507
Update train.py
72e605c 
error:

Incorrect pipe name (textcat_multilabel): By default, SpaCy's TextCategorizer pipeline is called textcat, not textcat_multilabel. You need to ensure that you have installed and are using a specific multi-label classification pipeline or that you're setting it up correctly. If you're aiming to use multi-label classification, consider handling it via textcat and properly setting multi-label categorization in your training data.


changes that i have made to the code:

textcat: Replaced textcat_multilabel with textcat.

Fixed random seed: Removed spacy.util.fix_random_seed and just used random.seed.

Vocabulary filtering: Added isalpha() check for vocabulary words to ensure only alphabetic words are saved.

Ensure you have the spacy-textcat component installed for multi-label text categorization.
@vignesh1507
Update prompts.py
f6ecb6f
@vignesh1507
Update requirements.txt
6a7a493
@vignesh1507 vignesh1507 changed the title Updated the library/module version in the requirements.txt file Updated the library/module versions in the requirements.txt file and also updated a few typos in the code. Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@vignesh1507