Executing huge queries or loops make qovery shell close server connection

Questions and Answers
1

I try to loop through thousands of records executing some stuff on them. After some records qovery shell exits with

ERRO[0031] connection closed by server: websocket: close 1011 (internal server error): EOF from upstream for stdout

The same happens when joining huge tables with hundred thousands of records. Is qovery shell somehow limited?

2

@Erebe do you have an idea?

3

Could you already find out anything regarding this issue?

4

Hello @ThomaSchneid,

Qovery shell is indeed limited,

  • You cannot send more than 10Mb over the connection in total
  • The connection is force closed after 1 hour

Going to bump the limit of data to 100Mb, the previous value was a conservative one, and as we don’t have much issue ATM.
I let you know

5

Can you retest @ThomaSchneid should be better now for you, I have increased the limit.

Let me know if it is not the case.

6

Hey @Erebe,

thanks a lot! It’s better now in terms of the data limit :slight_smile:

Could we increase the timeout period for qovery shell connection also, it times out after a few minutes of inactivity

7

Hi back @ThomaSchneid

Perfect, I already see you are using the shell with the limit unbounded on our monitoring :slight_smile:

Regarding the connection timeout on idle, sadly I am going to decline on this one, as maintaining open connections is costly for us.
I suggest you to do as I do when using aws ssh, when you plan to use the shell for a long time, just run a watch -n 10 date in it to avoid the connection breaking

8

Thanks a lot for the workaround :+1:

1 Like