Skip to content

Commit

Permalink
Merge pull request #111 from cisagov/improvement/remove-unnecessary-b…
Browse files Browse the repository at this point in the history
…eauty.sh-directive

Remove unnecessary lovesegfault/beautysh directive
  • Loading branch information
jsf9k authored Jan 31, 2024
2 parents 5d9bae7 + 819b594 commit ad8efff
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 7 deletions.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ FROM python:3.12.1-slim-bullseye
#
# Note: Additional labels are added by the build workflow.
###
LABEL org.opencontainers.image.authors="vm-fusion-dev-group@trio.dhs.gov"
LABEL org.opencontainers.image.authors="vm-dev@gwe.cisa.dhs.gov"
LABEL org.opencontainers.image.vendor="Cybersecurity and Infrastructure Security Agency"

###
Expand Down
6 changes: 0 additions & 6 deletions src/gather-domains.sh
Original file line number Diff line number Diff line change
Expand Up @@ -85,17 +85,11 @@ sed -i '/[^,]*,[^,]*,Library of Congress,/d;/[^,]*,[^,]*,Government Publishing O
# of these top-level domains is automatically extracted into the
# TOP_LEVEL_DOMAINS variable.
###
# beautysh doesn't handle this multiline $() correctly, so we have to
# temporarily turn off the formatting. I created
# lovesegfault/beautysh#82 to document this.
#
# @formatter:off
TOP_LEVEL_DOMAINS=$(cut --delimiter=, --fields=1 $OUTPUT_DIR/current-federal_modified.csv \
| awk -F"." '{if (NR > 1) print "."$NF;}' \
| sort --ignore-case --unique \
| tr "[:upper:]" "[:lower:]" \
| paste --serial --delimiters=,)
# @formatter:on
$HOME_DIR/domain-scan/gather current_federal,analytics_usa_gov,censys_snapshot,rapid,eot_2012,eot_2016,cyhy,other \
--suffix="$TOP_LEVEL_DOMAINS" --ignore-www --include-parents \
--parents=$OUTPUT_DIR/current-federal_modified.csv \
Expand Down

0 comments on commit ad8efff

Please # to comment.