Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 support #132

Open
upintheairsheep opened this issue Jan 24, 2023 · 4 comments
Open

S3 support #132

upintheairsheep opened this issue Jan 24, 2023 · 4 comments

Comments

@upintheairsheep
Copy link

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

http://apps.tvgam.es/
Please add support for Amazon S3 Open Directory links, and if possible add support for HighWinds too, I haven’t found out a way to get the next page of highwinds yet but I did on S3

http://cds.p6v7v3q9.hwcdn.net/

http://cds.i2m4y7a9.hwcdn.net/

Describe the solution you'd like
A clear and concise description of what you want to happen.

@KoalaBear84
Copy link
Owner

KoalaBear84 commented Jan 29, 2023

Hi, thanks for opening this issue. Was trying to implement this, but only made it worse, well, that's what it feels like 😅

I've added support for http://apps.tvgam.es/, but then got blocked after, to some degree, but it worked..

Then tried the others, but those don't return the header, so it took the other route in code, but failed. Fixed that, but then entering a never ending loop because the server doesn't respond like it use to do, if it was a real Amazon S3 API..

http://cds.p6v7v3q9.hwcdn.net/ returns with <NextMarker>FAM/J4/Launcher/Quad/Launcher_QC_2832_Alpha3.apk</NextMarker>, but when I want to retrieve the second page, it just returns the normal results. Because it returns the NextMarker, it looks like the older API, but sadly doesn't respond as it should be.

Example:
https://cds.p6v7v3q9.hwcdn.net/?list-type=2&delimiter=/&prefix=&marker=FAM%2FJ4%2FLauncher%2FQuad%2FLauncher_QC_2832_Alpha3.apk

This SHOULD start with FAM/J4/Launcher/Quad/Launcher_QC_2832_Alpha3.apk, but it just starts with 24XX_JApp/live.png as the starting url would do:
https://cds.p6v7v3q9.hwcdn.net/

So I'm stuck with this, I don't want a never ending loop. If there is a way to make it return the correct results, I would like to support it.

This one does support the new V2 listing and returns a NextContinuationToken:
https://data.openspending.org.s3.amazonaws.com/?list-type=2&delimiter=/&prefix=datasets/&max-keys=10

And also because it is not a 'real' / public bucket as it seems, <Name>cloudstream-d8c2-gcp-content</Name>:
https://cloudstream-d8c2-gcp-content.s3.amazonaws.com/

@KoalaBear84
Copy link
Owner

If anybody has any clue about this, please respond :)

@KoalaBear84
Copy link
Owner

KoalaBear84 commented Jan 29, 2023

Checked https://github.com/s3fs-fuse/s3fs-fuse and I see that it also support NextContinuationToken, which I will too if I get more info why the https://cds.p6v7v3q9.hwcdn.net/ doesn't work.

I've also asked @qoomon who might have more experience with it. Lets hope there is more info.

@upintheairsheep
Copy link
Author

upintheairsheep commented Jan 29, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants