System or closed process keeping a socket open on Windows

30 Oct 2019 / ERap320

While developing and debugging a C# program for a customer I noticed some very strange behaviour: when the program crashed or was terminated from the debugger (without having time to properly close a listening socket), the TCP port would stay open indefinitely. This was very annoying because after the crash I obviously couldn't restart the program without getting errors about the port being already open. Trying to close the socket from a handy program like cports didn't work at all: the process listening on the port was already dead, so it didn't know how to kill it! Not having much time to debug this I logged off and on my Windows account to force the socket to die every time the issue happened.

After implementation and testing of the most important features of the program I decided to look into the problem once more. At first I found some comments about how it's impossible to make Windows close listening sockets of a crashed application or that it closes itself after some minutes, but this sounded like complete nonsense to me. This is not the first network-involving program I write and I never stumbled in this problem before. The fact that it seemed to only happen "sometimes" made me skeptical this was a Windows problem. Didn't really know what to do with this information, so I went on googoling.

I started looking into socket settings or flags, trying to set linger options and timeouts, but that did nothing. I also went so far as to set ReuseAddr to make the errors go away. This option makes the program always connect to the port even if it's occupied, but this didn't solve the problem because now I couldn't detect if there was a REAL other program already listening. Moreover, my users could open the program many times and only one instance would actually receive packets. This was unacceptable at best.

In the end, some post I found and some tries lead me to the right idea: child processes. Since the program had to work with an Oculus Quest (an Android based VR headset), some functions interfaced with it by opening adb and parsing its console output. I quickly figured out the problem appeared only when I used some feature involving adb, and closing its process also freed the TCP port!

When I programmatically launched adb, it became a child process. This would be fine if adb.exe ended after giving me its output but, as any Android developer knows, it stays open in the background waiting for other requests. By default, the child process which outlives its parent inherits almost all of its handles, including sockets. To obtain the desired behaviour, I "just" had to disable the inheritance on the process or on the handle. Too bad there is no way to do it in C# when calling the child process. The introduction of some way to set inheritance flags with pure C# was proposed but as far as I can tell everything stopped there.

I decided to just call kernel32.dll and use Windows APIs to do this. Luckily, the C# Socket class includes a Handle parameter exposing the handle we need.

//Evil windows kernel magic to avoid adb keeping inherited sockets alive when the program crashes

[Flags]
public enum HANDLE_FLAGS : uint
{
     NONE = 0,
     INHERIT = 1,
     PROTECT_FROM_CLOSE = 2
}

[DllImport("kernel32.dll", SetLastError = true)]
private static extern bool SetHandleInformation(IntPtr hObject, HANDLE_FLAGS dwMask, HANDLE_FLAGS dwFlags);

//End of evil windows kernel magic

And when declaring the socket:

Socket socket = new Socket(IPAddress.Any.AddressFamily, SocketType.Stream, ProtocolType.Tcp);
SetHandleInformation(socket.Handle, HANDLE_FLAGS.INHERIT, 0);

Lenovo Watch MOD: change chinese apps in the notification options

14 Jul 2018 / ERap320

I recently bought a Lenovo Watch 9, and I love its hardware, but I can't say the same about the software. The Lenovo Watch app didn't have the quality I expected: for example, nobody tells you that the search of the watch will always fail unless you have the GPS of your phone turned on.

After I solved this little problem I found the watch quite useful, but couldn't get over the absence of useful apps to get notifications, like Telegram, my favourite mobile messaging service. I decided to just mod the app to remove the chinese apps (arguably useless for anyone outside of China) and replaced it with the apps from which I need notifications the most.

These are the replacements I made:

  • WeChat -> Telegram
  • QQ -> Microsoft Outlook
  • Weibo -> Google Calendar
  • Line -> Clock

I also fixed Skype notifications, which didn't work in the original application.

Changes

I hope this work will be useful to you too!

Download the latest version of the mod from its GitHub repository

DOWNLOAD

CrowLeer, the fast and reliable CLI web crawler with focus on pages download

16 Dec 2017 / ERap320

I recently decided to release a personal project of mine on GitHub. The name is CrowLeer and you can find it here.

In the last year I worked for a customer which needed a software capable of extracting particular data from a bunch of public websites' pages. I was ready to write the code for the recognition and storage of said data, but couldn't find any existing crawler that fit my needs. They come in all shapes:

  • Some offer a lot of very useful SEO data but can't download pages
  • Others have a download feature but lack the granular control needed to avoid downloading or following a great number of irrelevant pages
  • The ones which can download and have proper control over the flow of the crawling lack reliability or a proper way to be integrated with other software

I ended up using one of the previously mentioned "unreliable" ones (with loads of ad-hoc middleware) and called it a day, but months later decided to create my own as a personal project.

CrowLeer was created with simplycity, control and interfaceability in mind. You can find all the details in the GitHub page on the top of the article. I have plans to greatly expand its features but I already find it much more functional than many of the competitors I've worked with.

If you want to use it in your project, or just try it, you can send me feedback at my mail address. Even negative feedback will be much appreciated.



1 2 3 next ... end