Skip to content

Add "Accept-Encoding: gzip" header to mapd.py to reduce data consumption - #525

Merged
pd0wm merged 92 commits into
commaai:develfrom
eFiniLan:devel-osm-reduce-data-consumption
Feb 13, 2019
Merged

Add "Accept-Encoding: gzip" header to mapd.py to reduce data consumption#525
pd0wm merged 92 commits into
commaai:develfrom
eFiniLan:devel-osm-reduce-data-consumption

Conversation

@eFiniLan

@eFiniLan eFiniLan commented Feb 7, 2019

Copy link
Copy Markdown
Contributor

after a few tests, I noticed that overpass.kumi.systems server does not support any kind of response data compression.

The response data size greatly reduced when we use overpass-api.de server with "Accept-Encoding: gzip" header added.

With the same request, overpass-api.de: 271k vs overpass.kumi.systems: 2227k

image

We can potentially increase the radius to 9000 on overpass-api.de and consume around the same amount of data on overpass.kumi.systems with radius of 3000

image

Rick Lan and others added 30 commits August 30, 2018 16:11
…an/openpilot into devel-lexus-ish-ave30r

# Conflicts:
#	selfdrive/car/toyota/interface.py
…el-lexus-ish-ave30r

# Conflicts:
#	selfdrive/boardd/boardd.cc
#	selfdrive/car/toyota/interface.py
#	selfdrive/car/toyota/values.py
…el-lexus-ish-ave30r

# Conflicts:
#	selfdrive/car/toyota/interface.py
pd0wm pushed a commit that referenced this pull request May 29, 2020
b826734 Add pre commit checks + CI (#545)
339976c document tx message addresses better (#543)
a618e64 fix typing errors
9bece64 use mazda init
08db086 mazda cleanup
89658d0 Mazda: safety tests add missing safety checks (#525)
bdec139 Fix length of 0x20b in NISSAN_TX_MSGS, wasn't cancelling ACC (#544)
b48c74c Adding UNO to automated tests (#538)
a5802cd Hyundai: remove unused message from RX checks
9ebde25 Reset state on safety mode init (#542)
d4f3f15 Refactor addr check (#541)
5210e51 remove unused files
0657064 Hyundai checksum (#540)
07e668e Fast CI (#539)
5307bf7 Fix multi message iso tp requests
0610ed1 Hyundai wheel speed counter is actually 4 bits spread over two signals
0d581aa dockerfile optimization
eaefa2f fix docker file path
243a65f pull base image
0dd9470 only push to dockerhub from master
55b79b4 GitHub Actions (#535)
b2c720b Dos (#533)
01bf740 remove 0x1BE checksum test
0bd06c9 remove 0x1BE check (breaks some vehicles)
c31b899 honda bosch longitudinal safety
66250c4 Disable docker layer caching (#534)
6b19fa4 include nissan safety in release build
db31886 gate mazda safety behind debug flag
e4558c0 Safety: message length check on RX and TX (#529)

git-subtree-dir: panda
git-subtree-split: b826734
pd0wm pushed a commit that referenced this pull request May 31, 2020
49ffbe9 disable non-universal checks in hyundai safety
3a85f4c use whole route when running safety replay from CLI
098f47a Fix leaf brake rx check (#547)
b826734 Add pre commit checks + CI (#545)
339976c document tx message addresses better (#543)
a618e64 fix typing errors
9bece64 use mazda init
08db086 mazda cleanup
89658d0 Mazda: safety tests add missing safety checks (#525)
bdec139 Fix length of 0x20b in NISSAN_TX_MSGS, wasn't cancelling ACC (#544)
b48c74c Adding UNO to automated tests (#538)
a5802cd Hyundai: remove unused message from RX checks
9ebde25 Reset state on safety mode init (#542)
d4f3f15 Refactor addr check (#541)
5210e51 remove unused files
0657064 Hyundai checksum (#540)
07e668e Fast CI (#539)
5307bf7 Fix multi message iso tp requests
0610ed1 Hyundai wheel speed counter is actually 4 bits spread over two signals
0d581aa dockerfile optimization
eaefa2f fix docker file path
243a65f pull base image
0dd9470 only push to dockerhub from master
55b79b4 GitHub Actions (#535)
b2c720b Dos (#533)
01bf740 remove 0x1BE checksum test
0bd06c9 remove 0x1BE check (breaks some vehicles)
c31b899 honda bosch longitudinal safety
66250c4 Disable docker layer caching (#534)
6b19fa4 include nissan safety in release build
db31886 gate mazda safety behind debug flag
e4558c0 Safety: message length check on RX and TX (#529)

git-subtree-dir: panda
git-subtree-split: 49ffbe9
pd0wm pushed a commit that referenced this pull request May 31, 2020
9102c16 two spaces before inline comment
49ffbe9 disable non-universal checks in hyundai safety
3a85f4c use whole route when running safety replay from CLI
098f47a Fix leaf brake rx check (#547)
b826734 Add pre commit checks + CI (#545)
339976c document tx message addresses better (#543)
a618e64 fix typing errors
9bece64 use mazda init
08db086 mazda cleanup
89658d0 Mazda: safety tests add missing safety checks (#525)
bdec139 Fix length of 0x20b in NISSAN_TX_MSGS, wasn't cancelling ACC (#544)
b48c74c Adding UNO to automated tests (#538)
a5802cd Hyundai: remove unused message from RX checks
9ebde25 Reset state on safety mode init (#542)
d4f3f15 Refactor addr check (#541)
5210e51 remove unused files
0657064 Hyundai checksum (#540)
07e668e Fast CI (#539)
5307bf7 Fix multi message iso tp requests
0610ed1 Hyundai wheel speed counter is actually 4 bits spread over two signals
0d581aa dockerfile optimization
eaefa2f fix docker file path
243a65f pull base image
0dd9470 only push to dockerhub from master
55b79b4 GitHub Actions (#535)
b2c720b Dos (#533)
01bf740 remove 0x1BE checksum test
0bd06c9 remove 0x1BE check (breaks some vehicles)
c31b899 honda bosch longitudinal safety
66250c4 Disable docker layer caching (#534)
6b19fa4 include nissan safety in release build
db31886 gate mazda safety behind debug flag
e4558c0 Safety: message length check on RX and TX (#529)

git-subtree-dir: panda
git-subtree-split: 9102c16
pd0wm pushed a commit that referenced this pull request Jun 1, 2020
d7f7b14 Enable almost all Flake8 checks (#548)
3d5a717 fix whitespace after opening bracket
f70ef29 whitespace fix
eba113c backslash is redundant between brackets
8039638 fix linter complaint about unexpected spaces around keyword / parameter equals
275e76c fix linter complaint about too many blank lines
9102c16 two spaces before inline comment
49ffbe9 disable non-universal checks in hyundai safety
3a85f4c use whole route when running safety replay from CLI
098f47a Fix leaf brake rx check (#547)
b826734 Add pre commit checks + CI (#545)
339976c document tx message addresses better (#543)
a618e64 fix typing errors
9bece64 use mazda init
08db086 mazda cleanup
89658d0 Mazda: safety tests add missing safety checks (#525)
bdec139 Fix length of 0x20b in NISSAN_TX_MSGS, wasn't cancelling ACC (#544)
b48c74c Adding UNO to automated tests (#538)
a5802cd Hyundai: remove unused message from RX checks
9ebde25 Reset state on safety mode init (#542)
d4f3f15 Refactor addr check (#541)
5210e51 remove unused files
0657064 Hyundai checksum (#540)
07e668e Fast CI (#539)
5307bf7 Fix multi message iso tp requests
0610ed1 Hyundai wheel speed counter is actually 4 bits spread over two signals
0d581aa dockerfile optimization
eaefa2f fix docker file path
243a65f pull base image
0dd9470 only push to dockerhub from master
55b79b4 GitHub Actions (#535)
b2c720b Dos (#533)
01bf740 remove 0x1BE checksum test
0bd06c9 remove 0x1BE check (breaks some vehicles)
c31b899 honda bosch longitudinal safety
66250c4 Disable docker layer caching (#534)
6b19fa4 include nissan safety in release build
db31886 gate mazda safety behind debug flag
e4558c0 Safety: message length check on RX and TX (#529)

git-subtree-dir: panda
git-subtree-split: d7f7b14
pd0wm pushed a commit that referenced this pull request Jun 1, 2020
d7f7b14 Enable almost all Flake8 checks (#548)
3d5a717 fix whitespace after opening bracket
f70ef29 whitespace fix
eba113c backslash is redundant between brackets
8039638 fix linter complaint about unexpected spaces around keyword / parameter equals
275e76c fix linter complaint about too many blank lines
9102c16 two spaces before inline comment
49ffbe9 disable non-universal checks in hyundai safety
3a85f4c use whole route when running safety replay from CLI
098f47a Fix leaf brake rx check (#547)
b826734 Add pre commit checks + CI (#545)
339976c document tx message addresses better (#543)
a618e64 fix typing errors
9bece64 use mazda init
08db086 mazda cleanup
89658d0 Mazda: safety tests add missing safety checks (#525)
bdec139 Fix length of 0x20b in NISSAN_TX_MSGS, wasn't cancelling ACC (#544)
b48c74c Adding UNO to automated tests (#538)
a5802cd Hyundai: remove unused message from RX checks
9ebde25 Reset state on safety mode init (#542)
d4f3f15 Refactor addr check (#541)
5210e51 remove unused files
0657064 Hyundai checksum (#540)
07e668e Fast CI (#539)
5307bf7 Fix multi message iso tp requests
0610ed1 Hyundai wheel speed counter is actually 4 bits spread over two signals
0d581aa dockerfile optimization
eaefa2f fix docker file path
243a65f pull base image
0dd9470 only push to dockerhub from master
55b79b4 GitHub Actions (#535)
b2c720b Dos (#533)
01bf740 remove 0x1BE checksum test
0bd06c9 remove 0x1BE check (breaks some vehicles)
c31b899 honda bosch longitudinal safety
66250c4 Disable docker layer caching (#534)
6b19fa4 include nissan safety in release build
db31886 gate mazda safety behind debug flag
e4558c0 Safety: message length check on RX and TX (#529)

git-subtree-dir: panda
git-subtree-split: d7f7b14
66thparallel pushed a commit to 66thparallel/janes_openpilot_fork that referenced this pull request May 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants