Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GAE-S] can't upload zip files #734

Closed
VikramTiwari opened this issue Sep 7, 2018 · 4 comments
Closed

[GAE-S] can't upload zip files #734

VikramTiwari opened this issue Sep 7, 2018 · 4 comments

Comments

@VikramTiwari
Copy link

Using the example here to upload a file works totally fine from local (to gs) but won't work for zip files when deployed to app engine (standard). Only change made to file is to increase the limit to 1 GB on this line.

Attached are the sample zip files:

FL_insurance_sample.csv.zip
SampleZIPFile_10mbmb.zip

Not sure what I am doing wrong.
@VikramTiwari
Copy link
Author

@jasonpolites Any help on this?

@jasonpolites
Copy link
Contributor

App Engine has a 32MB file size (POST BODY) limit (https://cloud.google.com/appengine/quotas, search for "Incoming bandwidth"). We have some docs in Cloud Functions for how to do "large" file uploads that should work in App Engine without much re-work https://cloud.google.com/functions/docs/writing/http#file_uploads_using_cloud_storage

@VikramTiwari
Copy link
Author

VikramTiwari commented Sep 12, 2018 •
edited
Loading

Hey @jasonpolites Neither of the attached files are more than 30MB (including the whole POST body). On such files I am getting the proper error 413 Request Entity Too Large. But for zip files, I am getting the 500 Server Error even for 10kb zip files.

The code I am using is the same as in the example here:
https://github.com/GoogleCloudPlatform/nodejs-docs-samples/blob/master/appengine/storage/standard/app.js

Not sure what I am doing wrong. cc: @jmdobry

Gonna try the cloud-functions method.

@VikramTiwari
Copy link
Author

Using signed URLs worked fine. If I get time, I will add a PR for the signed-urls sample for app engine too.
Thanks for all the help @jasonpolites and @jmdobry 👍

This was referenced Jan 31, 2020
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
@snyk-bot snyk-bot mentioned this issue Aug 17, 2020
Open
This was referenced Apr 7, 2022
Open
Open
Open
Open
Open
Open
Open
grayside pushed a commit that referenced this issue Nov 11, 2022
@release-please
chore: release 4.1.2 (#734)
9f4b600 
🤖 I have created a release \*beep\* \*boop\*
---
### [4.1.2](https://www.github.com/googleapis/cloud-profiler-nodejs/compare/v4.1.1...v4.1.2) (2021-05-05)


### Bug Fixes

* **deps:** update dependency pprof to v3.1.0 ([#731](https://www.github.com/googleapis/cloud-profiler-nodejs/issues/731)) ([ba96e49](https://www.github.com/googleapis/cloud-profiler-nodejs/commit/ba96e49a2d254d713d55f16bedbf6a5268500801))
* **deps:** update dependency protobufjs to ~6.11.0 ([#733](https://www.github.com/googleapis/cloud-profiler-nodejs/issues/733)) ([33abbeb](https://www.github.com/googleapis/cloud-profiler-nodejs/commit/33abbebe1e6424658a66cdb728b93875d4edadd3))
---


This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
@grayside grayside mentioned this issue Nov 11, 2022
Merged
ace-n pushed a commit that referenced this issue Nov 12, 2022
@release-please
chore: release 4.1.2 (#734)
8f2752f 
🤖 I have created a release \*beep\* \*boop\*
---
### [4.1.2](https://www.github.com/googleapis/cloud-profiler-nodejs/compare/v4.1.1...v4.1.2) (2021-05-05)


### Bug Fixes

* **deps:** update dependency pprof to v3.1.0 ([#731](https://www.github.com/googleapis/cloud-profiler-nodejs/issues/731)) ([ba96e49](https://www.github.com/googleapis/cloud-profiler-nodejs/commit/ba96e49a2d254d713d55f16bedbf6a5268500801))
* **deps:** update dependency protobufjs to ~6.11.0 ([#733](https://www.github.com/googleapis/cloud-profiler-nodejs/issues/733)) ([33abbeb](https://www.github.com/googleapis/cloud-profiler-nodejs/commit/33abbebe1e6424658a66cdb728b93875d4edadd3))
---


This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
ace-n pushed a commit that referenced this issue Nov 14, 2022
@renovate-bot
chore(deps): update dependency @google-cloud/storage to v6 (#734)
15063e8
This was referenced Nov 14, 2022
Closed
Merged
ace-n pushed a commit that referenced this issue Nov 21, 2022
@renovate-bot
chore(deps): update dependency @google-cloud/storage to v6 (#734)
3886dca
ace-n pushed a commit that referenced this issue Nov 21, 2022
@renovate-bot
chore(deps): update dependency @google-cloud/storage to v6 (#734)
c91306a
Shabirmean pushed a commit that referenced this issue Feb 16, 2023
@alexander-fenster @gcf-owl-bot
test: fix sample test for listJobs (#734)
5854387 
* test: fix sample test for listJobs

* test: fix sample test for listJobs

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
@Shabirmean Shabirmean mentioned this issue Feb 16, 2023
Merged
This was referenced Jun 20, 2023
Open
Open
@pedroarapua pedroarapua mentioned this issue Jun 20, 2023
Open
@leejh3224 leejh3224 mentioned this issue Jun 20, 2023
Open
@pedroarapua pedroarapua mentioned this issue Jun 20, 2023
Open
@leejh3224 leejh3224 mentioned this issue Jun 21, 2023
Open
This was referenced Jun 21, 2023
Open
Open
Open
@leejh3224 leejh3224 mentioned this issue Jun 21, 2023
Open
@pedroarapua pedroarapua mentioned this issue Jun 21, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jasonpolites @VikramTiwari