Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Errors when indexed with the multi processing. #11556

Closed
njkim opened this issue Oct 18, 2024 · 0 comments · Fixed by #11557
Closed

Errors when indexed with the multi processing. #11556

njkim opened this issue Oct 18, 2024 · 0 comments · Fixed by #11557

Comments

@njkim
Copy link
Collaborator

njkim commented Oct 18, 2024

Not sure this only applies to multiprocessing, but when indexed with the multi processing option, the following errors occurs.

Traceback (most recent call last):
File "/opt/ENV/lib/python3.10/site-packages/arches/app/utils/index_database.py", line 167, in process_error_callback
raise err
ValueError: Chunk size must be strictly positive.
@njkim njkim mentioned this issue Oct 18, 2024
Merged
11 tasks
@njkim njkim linked a pull request Oct 18, 2024 that will close this issue
chunk size indexing, #11556 #11557
Merged
11 tasks
njkim added a commit that referenced this issue Oct 21, 2024
@njkim
Refactor getting the chunk size, #11556
55b8c2b
njkim added a commit that referenced this issue Oct 21, 2024
@njkim
Add the release note, #11556
2a7c000
jacobtylerwalls pushed a commit that referenced this issue Oct 21, 2024
@njkim
Prevent indexing errors for small batch sizes #11556 (#11557)
d0395e1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
pipeline
Status: ✅ Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

chunk size indexing, #11556 archesproject/arches
2 participants
@njkim @jacobtylerwalls