I am using the 1/4 release (file date) of the library and I am having an issue uploading files which are under 20k.

Could not properly upload file \APP03\ImportExport\NJ\180515\NJ_0615_UPL_130204_101618.exp to SFTP Server mft.amwater.com. Exception: Connection was lost
at Renci.SshNet.Sftp.SubsystemSession.WaitHandle(WaitHandle waitHandle, TimeSpan operationTimeout)
at Renci.SshNet.SftpClient.InternalUploadFile(Stream input, String path, SftpUploadAsyncResult asynchResult, Flags flags)
at Renci.SshNet.SftpClient.UploadFile(Stream input, String path, Boolean canOverride)
at RouteManager.General.SFTP.pushFileToFTP(String fullFileName)


Larger than 20k seem to work and I upload about a 150 files a day this way. I am doing a file.read and passing the stream to uploadFile.

Pushing the same file through FileZilla or other SFTP clients work fine.

What other steps can I take to diagnose the source of this problem?

Thanks for any suggesions
Rich

Hi,

Can you download latest version of the source code that I have?
I recently discovered some bug there that I fixed when it comes to uploading huge files but may be it will help in your case as well.
Also, when you get an exception, can you use debug version so I could see what line cause this exception, this will help me to identify it.

Thanks,
Oleg

The newest version of the code is hanging during the upload portion.

  using (Renci.SshNet.SftpClient sftp = new Renci.SshNet.SftpClient(host, uid, pwd))
        {
            using (Stream fin = File.OpenRead(fullFileName))
            {
                try
                {
                    sftp.ConnectionInfo.Timeout = new TimeSpan(0, 0, 30);


                    Logs.Info("Connecting:{0},{1},{2}", host,uid,pwd);
                    sftp.Connect();

                    Logs.Info("Connected, uploading file: {0}",fi.Name);
                    sftp.UploadFile(fin, hostPath + fi.Name);
                    Logs.Info("Uploaded {0} which was {1} bytes.", fi.Name, fi.Length);
                    Logs.Info("Transferred");
                    uploadSuccess = true;
                }
                catch (Exception e)
                {
                    Logs.Err("Could not properly upload file {1} to SFTP Server {0}. Exception: {2}\n{3}", host, fullFileName, e.Message,e.StackTrace);
                    return false;
                }
            }
        }

I see the message indicating Connected, uploading file.... but the process just hangs there. This is with a 19k file. With a 100k file the upload works perfectly.

Rich

Hmm,
ok, I will look at it later tonight then.
I guess one small questions, does it happens with smaller files too? like 1K or 2K or only around 18K-19K ?

Thanks,
Oleg

Just tried 2k and it worked just fine.

Rich

Hmm,
Then it seems to be a specific size project,
Ok, I will test for that then and see what I can find.

Thanks,
Oleg

Hi,

I just did a test with 18K, 19K and 20K and they all uploaded just fine here.

Can you may be provide me with a file that you trying to upload or its exact size in bytes so I could simulate the situation as close as possible?
Dont think you can attach files here in a forum so you can send file privately if needed.

Thanks,
Oleg

I did some additional testing on my side as well, it appears that the issue does not occur with winsshd (our personal sftp) but does occur with our business partner's server which is Ipswitch MoveIT. Let me anonimize one of the files and I will PM it to you.

Rich

Managed to get it to fail in debug mode. It is stuck on line 1499 in SFTPClient.cs.

Here is the debug message trace
SshNet.Logging Verbose: 1 : Initiating connect to 'XXX.XXX.XXXX:22'.
SshNet.Logging Verbose: 1 : Server version '2.0' on '9.99 sshlib: 7.0.0.0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'KeyExchangeInitMessage': 'SSH_MSG_KEXINIT'.
'SFTPTest.vshost.exe' (Managed (v4.0.30319)): Loaded 'C:\Windows\Microsoft.Net\assembly\GAC_MSIL\System.Dynamic\v4.0_4.0.0.0__b03f5f7f11d50a3a\System.Dynamic.dll', Skipped loading symbols. Module is optimized and the debugger option 'Just My Code' is enabled.
'SFTPTest.vshost.exe' (Managed (v4.0.30319)): Loaded 'Anonymously Hosted DynamicMethods Assembly'
SshNet.Logging Verbose: 1 : SendMessage to server 'KeyExchangeInitMessage': 'SSH_MSG_KEXINIT'.
SshNet.Logging Verbose: 1 : SendMessage to server 'KeyExchangeDhGroupExchangeRequest': 'SSH_MSG_KEX_DH_GEX_REQUEST'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'KeyExchangeDhGroupExchangeGroup': 'SSH_MSG_KEX_DH_GEX_GROUP'.
SshNet.Logging Verbose: 1 : SendMessage to server 'KeyExchangeDhGroupExchangeInit': 'SSH_MSG_KEX_DH_GEX_INIT'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'KeyExchangeDhGroupExchangeReply': 'SSH_MSG_KEX_DH_GEX_REPLY'.
SshNet.Logging Verbose: 1 : SendMessage to server 'NewKeysMessage': 'SSH_MSG_NEWKEYS'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'NewKeysMessage': 'SSH_MSG_NEWKEYS'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ServiceRequestMessage': 'SSH_MSG_SERVICE_REQUEST'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ServiceAcceptMessage': 'SSH_MSG_SERVICE_ACCEPT'.
SshNet.Logging Verbose: 1 : SendMessage to server 'RequestMessageNone': 'SSH_MSG_USERAUTH_REQUEST'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'FailureMessage': 'SSH_MSG_USERAUTH_FAILURE'.
SshNet.Logging Verbose: 1 : SendMessage to server 'RequestMessagePassword': 'SSH_MSG_USERAUTH_REQUEST'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'SuccessMessage': 'SSH_MSG_USERAUTH_SUCCESS'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelOpenMessage': 'SSH_MSG_CHANNEL_OPEN : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelOpenConfirmationMessage': 'SSH_MSG_CHANNEL_OPEN_CONFIRMATION : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelRequestMessage': 'SSH_MSG_CHANNEL_REQUEST : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelSuccessMessage': 'SSH_MSG_CHANNEL_SUCCESS : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
Connected, uploading file: NJ_0615_UPL_130204_101620.expSshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : SendMessage to server 'ChannelDataMessage': 'SSH_MSG_CHANNEL_DATA : #0'.
SshNet.Logging Verbose: 1 : ReceiveMessage from server: 'DisconnectMessage': 'SSH_MSG_DISCONNECT'.
SshNet.Logging Verbose: 1 : Disconnect received: ProtocolError data exceeds negative window tolerance

In debug the error seems inconsistent, it failed 2 out of 3 tries where in release it fails far more often.

Hope this helps.

Rich

Hmm,

Now it actually gives me a little bit more information "ProtocolError data exceeds negative window tolerance".

What is exact file size in bytes that you trying to upload, is it 18848, the one you sent me or different?

Also, I will try to investigate now that "ProtocolError data exceeds negative window tolerance" error since I never saw it before but have one idea where it might be coming from.
I just want to get to situation where I can recreate this issue locally so I wont have to ask you to try things.

Thanks,
Oleg

<div>Yes it was the same size file.</div> <div><br> </div> <div>Rich</div> <div><br> On Feb 4, 2013, at 8:38 PM, &quot;olegkap&quot; &lt;<a href="mailto:notifications@codeplex.com">notifications@codeplex.com</a>&gt; wrote:<br> <br> </div> <div><span></span></div> <blockquote type="cite"> <div> <p>From: olegkap</p> <div id="ThreadNotificationPostBody">Hmm, Now it actually gives me a little bit more information &quot;ProtocolError data exceeds negative window tolerance&quot;. What is exact file size in bytes that you trying to upload, is it 18848, the one you sent me or different? Also, I will try to investigate now that &quot;ProtocolError data exceeds negative window tolerance&quot; error since I never saw it before but have one idea where it might be coming from. I just want to get to situation where I can recreate this issue locally so I wont have to ask you to try things. Thanks, Oleg</div> </div> </blockquote>

ok, thanks,
I will try to see if I can recreate it and find the problem.

Thanks,
Oleg

Hey,

Just wanted to give you a little update.
Unfortunately it takes a little bit longer then expected.
Every time I think I got a fix, I found another issue, and usually it has to do with multithreading and operation synchronization.

Hope it resolve it as soon as possible.
Thanks,
Oleg

Hey thank you very much for the update, and for the time you are taking on this.
Rich

Hi Rich,

I just committed some fixes where I improved server window management, which I think causes you a problem.
But, my suspicion it still might not work, and this is due to server specific implementation of window management.
My suspicion that it waits for window to be 0 before expanding it but I couldn't manage to handle this situation properly so far, I think, since all implementation that I have access to handle it differently.

If you think it would be possible for me to get an access to this device with some test credentials, I probably could see if I could handle this situation a little better.
But I guess for now, see if current commit fixes it, and if not I would just log it as an Issue so other people could see that and I could get back to it later.
May be someone could get me access to one of such devises in case you can not.

Thanks,
Oleg

It is not my server so I will need to request it. Let me see if IPSWITCH has a demo version of their server as well.

Rich

ok,
Thanks,
Yea let me know if it does and where to get it, I could install it then on one of VMs here.

Thanks,
Oleg

Hello, Oleg!
Now I have same problem... File is really have uploaded but the process just hangs there.
Can I see your solve for testing?

In last Source code problem is solved!

Thanks!