Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GetRemoteBlobs operations blocks when multi threads request alarge number of objects and delete this objects at the same time. #1960

Open
vegetableysm opened this issue Jul 26, 2024 · 3 comments
Assignees
Labels
performance Issues that related to the performance of vineyardd and vineyard SDKs. stale

Comments

@vegetableysm
Copy link
Collaborator

Describe your problem

The get operation blocks when multiple threads request a large number of objects at the same time and some threads tries to delete the object.

@vegetableysm vegetableysm added the bug Something isn't working label Jul 26, 2024
@vegetableysm vegetableysm self-assigned this Jul 26, 2024
@vegetableysm vegetableysm moved this from Todo to In Progress in Vineyard Releases Jul 26, 2024
@vegetableysm
Copy link
Collaborator Author

Not a dead lock problem. It is just too slow.
Put 10000 small objects and use 4 thread to get(remote buffer). The total spent time is 100 times than 1000 small objects on TCP.
image

@vegetableysm vegetableysm added performance Issues that related to the performance of vineyardd and vineyard SDKs. and removed bug Something isn't working labels Jul 26, 2024
@vegetableysm vegetableysm moved this from In Progress to Todo in Vineyard Releases Jul 26, 2024
@github-actions github-actions bot added the stale label Aug 12, 2024
Copy link
Contributor

/cc @vegetableysm, this issus/pr has had no activity for for a long time, could you folks help to review the status ?
To suppress further notifications,

  • for issues,
    • if it is waiting for further response from the reporter/author, please help to add the label requires-further-info,
    • if you have already started working on it, please add the label work-in-progress to the issue,
    • if this issue requires further designing discussion and not in current plan, or won't be fixed, please add the label requires-further-discussion or wontfix to the issue,
  • for pull requests,
    • if you are still working on it and it is not ready for reviewing, please convert this pull request as draft PR,
    • if you have decided to hold this development on, please add the requires-further-discussion label to the pull request.
      Thanks!

@vegetableysm vegetableysm moved this from Todo to In Progress in Vineyard Releases Aug 27, 2024
@github-actions github-actions bot removed the stale label Sep 12, 2024
@github-actions github-actions bot added the stale label Oct 12, 2024
Copy link
Contributor

/cc @vegetableysm, this issus/pr has had no activity for for a long time, could you folks help to review the status ?
To suppress further notifications,

  • for issues,
    • if it is waiting for further response from the reporter/author, please help to add the label requires-further-info,
    • if you have already started working on it, please add the label work-in-progress to the issue,
    • if this issue requires further designing discussion and not in current plan, or won't be fixed, please add the label requires-further-discussion or wontfix to the issue,
  • for pull requests,
    • if you are still working on it and it is not ready for reviewing, please convert this pull request as draft PR,
    • if you have decided to hold this development on, please add the requires-further-discussion label to the pull request.
      Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Issues that related to the performance of vineyardd and vineyard SDKs. stale
Projects
Status: In Progress
Development

No branches or pull requests

1 participant