Lots of timeout when using API

  • 2
  • Problem
  • Updated 5 months ago
Hi,

We are using the API from a PHP application which upload files (a lot).
We have seen a lot of issue about timeout when trying to upload files.

Is there any kind of limitation about API calls per seconds/minutes? It is possible that we are temporary  banned?
Photo of Florian Desneux

Florian Desneux

  • 19 Posts
  • 2 Reply Likes
  • confused

Posted 6 months ago

  • 2
Photo of Pratik Somanagoudar

Pratik Somanagoudar, Employee

  • 14 Posts
  • 1 Reply Like
Hi Florian,

Sorry to hear that you are facing issues with upload timeouts. To help us understand the problem can you tell us whether you are using an on-prem sharefile storage center. Also if you can tell us the rate of uploads expected from your application.

Thanks
Pratik S
Photo of Florian Desneux

Florian Desneux

  • 19 Posts
  • 2 Reply Likes
We are not using on-prom storage.

We are calling the API in average 40 times per minute to store documents.
In rare case, it can be 120 times per minutes (3 processes in the same time doing different things).
Photo of Luke Skrzypek

Luke Skrzypek, Employee

  • 52 Posts
  • 7 Reply Likes
We do some throttling, but that would usually show up as a 429 (Too Many Requests) response rather than timeouts. 
If you're not getting any response, can you check how long your timeout is?
It would also help if you could share your account id or subdomain either here or privately.
Photo of Luke Skrzypek

Luke Skrzypek, Employee

  • 52 Posts
  • 7 Reply Likes
You can upload a text file here with your account id/subdomain
https://skrzypek.sharefile.com/r-r98dd172ac0842fca
Photo of Florian Desneux

Florian Desneux

  • 19 Posts
  • 2 Reply Likes
I have uploaded the file :)
Photo of Eliezer Encarnacion

Eliezer Encarnacion, Official Rep

  • 709 Posts
  • 99 Reply Likes
Florian,

I'll be taking a look at this issue. I'll look into your account logs and will let you know today what we can do to alleviate the timeouts. Thanks for your patience!

Eli
Photo of Eliezer Encarnacion

Eliezer Encarnacion, Official Rep

  • 709 Posts
  • 99 Reply Likes
Florian,

Here's what I found in my search. While your application is not being explicitly throttled, it is putting a lot of load on your account and resulting in the timeouts and deadlocks. I recommend you put some checks on your end to reduce the number of uploads to around 20 per minute. We believe at that rate it should work well, though you may see an occasional timeout, for which we recommend adding some retry logic.

Let me know if you have any questions or concerns.

Thanks!
Eli
Photo of Florian Desneux

Florian Desneux

  • 19 Posts
  • 2 Reply Likes
Hi Eliezer,

Thank you for your reply.

We have implemented the logic to reduce the number of files uploaded per minutes.

We are monitoring it right now.

Florian