Recently I needed to have something that allows me to have more control over my data stream client, so that:
- When desired, it would stop and close the connection as gracefully as possible.
- A precise counter for how many records have been received is in place.
The initial implementation was quite straightforward:
Though practical, this approach could be improved much further, in particular:
- Lacks the capability to flip the switch on and off on demand.
- The number of records needs to be saved “manually”, and only at the end of the session (excluding the possibility of nasty interpolation). Something that’s accessible mid-session is much more preferable.
Coming up next, we’ll tame (Py)cURL further A_A