Backfill unit tests

[rshipp]

Write unit tests for existing code.

RSS Source

• [x] run_respects_saved_state
• [x] run_does_preprocessing_deobfuscation
• [x] run_respects_feed_type
• [x] run_supports_both_content_summary
• [x] run_supports_both_link_url
• [x] run_returns_top_item_date_as_saved_state
• [x] run_returns_artifacts_correctly

Twitter Source

• [x] init_detects_search_type
• [x] run_respects_saved_state
• [x] run_returns_newest_tweet_id_as_saved_state
• [x] run_supports_all_endpoints
• [x] run_returns_artifacts_correctly

ThreatKB Operator

• [x] handle_domain_creates_domain
• [x] handle_ipaddress_creates_ipaddress
• [x] handle_yarasignature_creates_yarasignature

SQS Operator

• [x] handle_url_discards_ip_urls
• [x] handle_url_passes_kwargs

Config

• [x] daemon_returns_main_daemon_bool
• [x] sleep_returns_main_sleep_int
• [x] sources_returns_list_of_all_source_tuples
• [x] sources_excludes_internal_options_from_kwargs
• [x] operators_returns_list_of_all_operator_tuples
• [x] operators_excludes_internal_options_from_kwargs
• [x] save_state_writes_saved_state
• [x] get_state_reads_saved_state

Source base class

• [x] init_raises_not_implemented
• [x] run_raises_not_implemented
• [x] truncate_length_is_respected
• [x] content_is_preprocessed
• [x] urls_are_extracted
• [x] ips_are_extracted
• [x] yara_sigs_are_extracted
• [x] urls_matching_reference_link_are_discarded
• [x] nonobfuscated_urls_are_discarded
• [x] nonobfuscated_urls_are_included_if_specified

Operator base class

• [x] default_artifact_types_is_empty
• [x] handle_artifact_raises_not_implemented
• [x] process_includes_only_artifact_types

Ingestor class

• [x] init_creates_sources_operators_dicts
• [x] run_checks_config_daemon
• [x] run_once_calls_run_process_save_state

[rshipp]

Completed in 7b787deee91ebfa6495b9a0463f192ab582b0eb1