sungchun12 / fst

fst: flow state tool | smooth where you want it, friction where you need it when data engineering
https://www.loom.com/share/ecfbdfb981e4443d94d2c95f16176118
Apache License 2.0
32 stars 1 forks source link

Checkout https://facebook.github.io/watchman/ and see if that's better than watchdog #11

Open sungchun12 opened 1 year ago

sungchun12 commented 1 year ago

Watchman and Watchdog are both popular tools for detecting file modifications in a directory, but they have some differences in terms of performance, platform support, and implementation. Watchman: Developed and maintained by Facebook. Written in C++, providing better performance in large projects. Uses native operating system APIs for file system monitoring, making it highly efficient. Supports Linux, macOS, Windows, and FreeBSD. Requires installation of a separate service (the Watchman daemon) that runs in the background. Comes with a command-line interface and JSON-based IPC protocol for integration with other tools. Extensively used in large projects and by large organizations, indicating its reliability and stability. Watchdog: A Python library, which may not provide as good performance as Watchman, especially for large projects. Cross-platform, supporting Linux, macOS, and Windows. Uses native operating system APIs for file system monitoring where available (inotify on Linux, FSEvents on macOS, ReadDirectoryChangesW on Windows), and falls back to a polling-based approach when native APIs are not available. Easier to integrate into Python applications, as it's a Python library. No need to install or manage a separate service. Might be less efficient and slower than Watchman when monitoring large directory trees. In summary, Watchman tends to be more performant, especially for large projects, and it supports more platforms (including FreeBSD). However, Watchdog is easier to integrate into Python applications and doesn't require a separate service to be installed and managed. Both tools are platform-agnostic, but Watchman is generally considered more efficient and reliable in large-scale projects due to its lower-level implementation in C++ and its use of native operating system APIs for file system monitoring.