How to access S-2 meta-data in AWS after bucket goes to Requester pays?

Hi, tested at 14:25 utc for two scenes. tileInfo.json works and metadata.xml return Error 503.

Tests:

https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/metadata.xml ERROR
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/metadata.xml ERROR

The Error is:

503 ERROR
The request could not be satisfied.
The Lambda function associated with the CloudFront distribution is invalid or doesn’t have the required permissions.
If you received this error while trying to use an app or access a website, please contact the provider or website owner for assistance.
If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by following steps in the CloudFront documentation (http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/http-503-service-unavailable.html).

Generated by cloudfront (CloudFront)
Request ID: ba7JhQYbdPvUXe2osi0UDDhrwWiRLvibHlflNRAAZ_xv6kPZQg-k9g==

metadata.xml is working now. Thanks!

I can access to metadata.xml now!!
Many thanks for your great work.

Hello,

metadata for your tile is here: https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/metadata.xml

Metadata files are not in requester pays buckets

Hello everydbody.
I have access to metadata.xml but I need also, as before the requester pays changes, the access to product metadata.xml.
I trying to access via AWS CLI but the results is this:
aws s3 cp s3://sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/productmetadata.xml C:\Users\User\Desktop\prova\productmetadata.xml --region eu-central-1 --request-payer requester
fatal error: An error occurred (404) when calling the HeadObject operation: Key “tiles/32/T/QM/2018/9/8/0/productmetadata.xml” does not exist

Does anybody know where the product metadata is?

Are you maybe referring to this file:
s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/datastrip/0/metadata.xml

productmetadata.xml doesn’t ring a bell to me

No, I am not looking for the metadata.xml, I am looking for the file productmetadata.xml, which is different because it contains (better, It was containing before the requester aws changes) all the radiometric informations about bands and much more.
It was locate, before the pays changes, here: http://sentinel-s2-l1c.s3.amazonaws.com/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/productmetadata.xml (it an example…)
anybody can help me?
thanks you a lot

Are you referring to productInfo.json file? This is available also now. There was never “productmetadata.xml” file available on AWS.

Dear rksoir!
Yes, Here i find the data that interest me, that are solar irradiance values, quantification value, physical gain etc…So thank you! I am very happy.
But, before the request changes, I was downloading very small size productmetadata.xml with the values i need…
But at moment it is ok, I hope. Thank you!

Dear all,

I was looking for to this product (here there’s an image of Sentinel Esa Products Guide)

and, on this product I was interested in these values (quantification values, solar irradiance…)

I’m sorry, the name “productmetadata.xml” was only a rename that I used. Sorry.
Anyway, the product I was looking for it is the one in the last screenshot image.

A post was merged into an existing topic: Sentinel s2 l1c - 502 error by cloudfront - Unable to access meta-files and preview image from http

Dear all,
I think at the moment I am ok. Changing the url strip, I was able to find the metdata.xml I was looking for. s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/metadata.xml

Thanks to all for your great help.

Hi @gjb.crs4,
we will look into it but I cannot promise, when this will happen. We are spending significant resources to have the data synced at all so these kind of rare problems are of lower priority, especially if related to the old data.

I am happy that you provide permanent open access to the Sentinel-2 L1C meta-data as announced above.

Indeed I use your json url interface to check for product availability. By and large it works fine.
However, there are rare cases when roda. sentinel-hub. com responds no product (KeyCount: 0) when there is actual product on the official Copernicus sci-hub.

e.g.: https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/32/S/MJ/2017/9/16/

(at Copernicus sci-hub the quicklook when download is called:
S2B_MSIL1C_20170919T102009_N0205_R065_T32SMJ_20170919T102557-ql.jpg)

Q: if I supply a list of such missing items would it possible for their meta-data to be restored to roda. sentinel-hub .com ?

Sincerely

G Brelstaff CRS4 Sardinia