Skip to content

Improve URL event stdout display format#3023

Merged
liquidsec merged 1 commit into
3.0from
url-display-format
Apr 3, 2026
Merged

Improve URL event stdout display format#3023
liquidsec merged 1 commit into
3.0from
url-display-format

Conversation

@liquidsec

Copy link
Copy Markdown
Collaborator

Summary

  • URL events now display as [status] url instead of raw JSON dict
  • Titles shown as [200] https://example.com - [Page Title]
  • Redirects show target: [302] https://old.com -> https://new.com
  • Unverified URLs display as bare URL (no status code yet)
  • Added redirect_location property to URL events, populated by httpx

Closes #3020

Show status code, URL, title, and redirect target instead of raw JSON dict.
@github-actions

github-actions Bot commented Apr 3, 2026

Copy link
Copy Markdown
Contributor

📊 Performance Benchmark Report

Comparing 3.0 (baseline) vs url-display-format (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name 📏 Base 📏 Current 📈 Change 🎯 Status
Bloom Filter Dns Mutation Tracking Performance 4.32ms 4.29ms -0.8%
Bloom Filter Large Scale Dns Brute Force 18.47ms 17.56ms -4.9%
Large Closest Match Lookup 340.54ms 331.89ms -2.5%
Realistic Closest Match Workload 178.56ms 178.56ms -0.0%
Event Memory Medium Scan 1784 B/event 1784 B/event +0.0%
Event Memory Large Scan 1768 B/event 1768 B/event +0.0%
Event Validation Full Scan Startup Small Batch 391.94ms 373.86ms -4.6%
Event Validation Full Scan Startup Large Batch 517.89ms 521.70ms +0.7%
Make Event Autodetection Small 25.51ms 25.90ms +1.5%
Make Event Autodetection Large 255.43ms 259.02ms +1.4%
Make Event Explicit Types 10.77ms 10.99ms +2.1%
Excavate Single Thread Small 3.445s 3.488s +1.3%
Excavate Single Thread Large 8.744s 8.786s +0.5%
Excavate Parallel Tasks Small 3.652s 3.689s +1.0%
Excavate Parallel Tasks Large 6.853s 6.876s +0.3%
Is Ip Performance 3.22ms 3.20ms -0.6%
Make Ip Type Performance 11.51ms 11.42ms -0.8%
Mixed Ip Operations 4.59ms 4.48ms -2.4%
Memory Use Web Crawl 44.0 MB 47.0 MB +6.8%
Memory Use Subdomain Enum 19.4 MB 19.4 MB +0.0%
Scan Throughput 100 7.843s 7.817s -0.3%
Scan Throughput 1000 36.864s 37.756s +2.4%
Typical Queue Shuffle 62.15µs 61.84µs -0.5%
Priority Queue Shuffle 706.74µs 713.84µs +1.0%

🎯 Performance Summary

No significant performance changes detected (all changes <10%)


🐍 Python Version 3.11.15

@codecov

codecov Bot commented Apr 3, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 78.26087% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 91%. Comparing base (edefefc) to head (32b8692).
⚠️ Report is 2 commits behind head on 3.0.

Files with missing lines Patch % Lines
bbot/core/event/base.py 75% 5 Missing ⚠️
Additional details and impacted files
@@          Coverage Diff          @@
##             3.0   #3023   +/-   ##
=====================================
- Coverage     91%     91%   -0%     
=====================================
  Files        440     440           
  Lines      37330   37353   +23     
=====================================
+ Hits       33809   33827   +18     
- Misses      3521    3526    +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@liquidsec liquidsec merged commit b4e4718 into 3.0 Apr 3, 2026
17 of 18 checks passed
@liquidsec liquidsec deleted the url-display-format branch April 3, 2026 19:21
@liquidsec liquidsec mentioned this pull request Apr 3, 2026
@liquidsec liquidsec mentioned this pull request Jun 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants