Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

hadoop aws depenencies in rasterframes-notebooks #38

Closed
vpipkt opened this issue May 30, 2018 · 1 comment
Closed

hadoop aws depenencies in rasterframes-notebooks #38

vpipkt opened this issue May 30, 2018 · 1 comment
Milestone

Comments

@vpipkt
Copy link
Member

vpipkt commented May 30, 2018

Add hadoop aws dependencies for accessing data via s3a in the rasterframes-notebooks build.

May also be good to show this in an example, including authorization.

metasim added a commit that referenced this issue Apr 24, 2019
@metasim metasim added this to the 0.8.1 milestone Jul 25, 2019
@metasim metasim modified the milestones: 0.8.1, 0.8.2 Aug 23, 2019
@vpipkt
Copy link
Member Author

vpipkt commented Aug 23, 2019

Issue is stale. We can read successfully with the following:

But not this:

  • s3a://${bucket}/${prefix}

The errror we see on stderr is below. This all seems consistent with documented use of HDFS versus GDAL schemes and such. Will file a new issue to clarify the fix for this.

ERROR 4: landsat-pds/c1/L8/190/028/LC08_L1TP_190028_20190705_20190719_01_T1/LC08_L1TP_190028_20190705_20190719_01_T1_B8.TIF: No such file or directory
2019-08-23 17:39:45 ERROR RasterSourceToRasterRefs:77 - Error fetching data for one of: GDALRasterSource(s3a://landsat-pds/c1/L8/190/028/LC08_L1TP_190028_20190705_20190719_01_T1/LC08_L1TP_190028_20190705_20190719_01_T1_B8.TIF)
java.lang.Exception: get_transform or get_widht_height
	at geotrellis.contrib.vlm.gdal.GDALDataset$.rasterExtent$extension1(GDALDataset.scala:45)
	at geotrellis.contrib.vlm.gdal.GDALDataset$.rasterExtent$extension0(GDALDataset.scala:37)
	at geotrellis.contrib.vlm.gdal.GDALBaseRasterSource$class.rasterExtent(GDALBaseRasterSource.scala:69)
	at geotrellis.contrib.vlm.gdal.GDALRasterSource.rasterExtent$lzycompute(GDALRasterSource.scala:22)
	at geotrellis.contrib.vlm.gdal.GDALRasterSource.rasterExtent(GDALRasterSource.scala:22)
	at geotrellis.contrib.vlm.RasterSource$class.cols(RasterSource.scala:76)
...
...
...

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants