How to stream large files with O(1) memory, composable transducers, and automatic resource cleanup
You need to process large files from cloud storage. Each file has a header line followed by tens of thousands of data rows. The rows must be parsed, transformed, and written to a database in batches.
| #!/bin/bash | |
| ## Create the response FIFO | |
| rm -f response | |
| mkfifo response | |
| function handle_GET_home() { | |
| RESPONSE=$(cat home.html | \ | |
| sed "s/{{$COOKIE_NAME}}/$COOKIE_VALUE/") | |
| } |
Coming from a Haskell background and landing on Clojure-land, I had a lot of difficulty grasping some design decisions, specially regarding parameter order and the use of threading macros. This post aims to shed a light on some design decisions Clojure took and reason about whether or not, how or when should you use thread macros. This is an entirely personal opinion, but reasonable arguments are given.
| import requests # dependency | |
| url = "<your url>" # webhook url, from here: https://i.imgur.com/f9XnAew.png | |
| # for all params, see https://discordapp.com/developers/docs/resources/webhook#execute-webhook | |
| data = { | |
| "content" : "message content", | |
| "username" : "custom username" | |
| } |
| // import_json_appsscript.js | |
| // https://gist.github.com/allenyllee/c764c86ed722417948fc256b7a5077c4 | |
| // | |
| // Changelog: | |
| // (Oct. 16 2019) tag: allenyllee-20191016 | |
| // 1. Fixed google script error: urlfetchapp - service invoked too many times https://stackoverflow.com/questions/10598179/google-apps-script-urlfetchapp-service-invoked-too-many-times | |
| // (Jul. 16 2018) tag: allenyllee-20180716 | |
| // 1. Fixed the issue "If you try to query /arrayA[k]/arrayB[n]/arrayC[m]/.../member, you will always get /arrayA[k]/arrayB[k]/arrayC[k]/.../member." | |
| // (Nov. 30 2017) tag: allenyllee-20171130 | |
| // 1. Add the ability to query array elements by using xpath like "/array[n]/member" where "n" is array index |
| """ | |
| Python script to interact with existing Windows Task Scheduler tasks. | |
| CLI usage: | |
| python windows_task_scheduler.py {enable|disable|run} -t "TaskName" | |
| import usage: | |
| import windows_task_scheduler as wts | |
| wts.enable_task(task_name='TaskName') | |
| wts.disable_task(task_name='TaskName') |
| - Open Automator | |
| - File -> New -> Service | |
| - Change "Service Receives" to "files or folders" in "Finder" | |
| - Add a "Run Shell Script" action | |
| - Change "Pass input" to "as arguments" | |
| - Paste the following in the shell script box: open -n -b "com.microsoft.VSCode" --args "$*" | |
| - Save it as something like "Open in Visual Studio Code" |
| ### | |
| ### | |
| ### UPDATE: For Win 11, I recommend using this tool in place of this script: | |
| ### https://christitus.com/windows-tool/ | |
| ### https://github.com/ChrisTitusTech/winutil | |
| ### https://www.youtube.com/watch?v=6UQZ5oQg8XA | |
| ### iwr -useb https://christitus.com/win | iex | |
| ### | |
| ### OR take a look at | |
| ### https://github.com/HotCakeX/Harden-Windows-Security |
| #!/bin/bash | |
| ##################################################### | |
| # Name: Bash CheatSheet for Mac OSX | |
| # | |
| # A little overlook of the Bash basics | |
| # | |
| # Usage: | |
| # | |
| # Author: J. Le Coupanec | |
| # Date: 2014/11/04 |
