Servers by jDrones

Log files & privacy


(Thomas) #1

Hi,

I am curious, if someone already thought about privacy and GPS locations in published log files.
I could imagine a tool to offset the GPS statements in a log with a random or given number.

Does anyone coded or know some tool to do so?


(Fnoop) #2

Hi, I’ve looked at this very thing last week (nothing to do with the GCS software you’ve tagged though). If you look at this demo:
http://www.maverick.one/analysis/uploader/
There’s an option to anonymise the GPS data. It does this by taking the first non-zero data for GPS lat and long and using that as the offset, so all the GPS data starts at 0,0.
The code is here:
https://github.com/fnoop/maverick/blob/master/manifests/maverick-modules/maverick_analysis/files/maverick-mavlogd#L64
and here
https://github.com/fnoop/maverick/blob/master/manifests/maverick-modules/maverick_analysis/files/maverick-mavlogd#L195

It’s not pretty or sophisticated!
Here’s an example logfile that someone uploaded and anonymized:
http://www.maverick.one/analysis/grafana/dashboard/db/flight-data-analysis?orgId=10&from=1497450574000&to=1497451385000


(peterbarker) #3

Hi, I’ve looked at this very thing last week (nothing to do with the GCS
software you’ve tagged though). If you look at this demo:
http://www.maverick.one/analysis/uploader/
There’s an option to anonymise the GPS data. It does this by taking the
first non-zero data for GPS lat and long and using that as the offset, so
all the GPS data starts at 0,0.
The code is here:

This should always be done as a whitelist of messages and fields which are
acceptable. We emit location in many places.

Peter


(Fnoop) #4

Oh, like what other kind of messages emit location? Is there a list anywhere? It might be good info to put on the wiki.


(peterbarker) #5

Oh, like what other kind of messages emit location? Is there a list
anywhere? It might be good info to put on the wiki.

Sorry, but still, that’s the wrong question - and if I were to try to
answer it I’d get it wrong. Probably immediately, but my answer would
definitely be wrong in a year :slight_smile: A quick look shows me
Log_Write_Home_And_Origin will probably emit lat and lon, to give you an
example, however. Probably GPSB, too, come to think of it…

“What messages+fields don’t emit location” is the question you need to
ask. And the answer to that is quite long - and no, we really don’t have
that list either :slight_smile: (yet? :wink: )

he good thing about a whitelist is that if it does get out of date it
should still produce logs that were as useful initially - just not as
useful as they could be. And unless someone does something really silly,
any filtered logs you produce will be “safe”.

Peter


Visit Topic or reply to this email to respond.


In Reply To

[45.png]
peterbarker
December 6 Hi, I’ve looked at this very thing last week (nothing to do with
the GCS software you’ve tagged though). If you look at this demo:
http://www.maverick.one/analysis/uploader/ There’s an option to anonymise
the GPS data. It does this by taking the first non-zero data for GPS lat
and long and using tha…


Heads up: We send a maximum of 100 daily emails. Check the site to see the
ones that might be held back. PS thanks for being popular!


Visit Topic or reply to this email to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, click here.

Peter Barker | Programmer,Sysadmin,Geek.
pbarker@barker.dropbear.id.au | You need a bigger hammer.
:: It’s a hack! Expect underscores! - Nigel Williams


(Thomas) #6

Hi,
I am still trying to understand your code. :sweat_smile:
I would like to develope an C# app for doing that, but as I am not a professional programmer I don’t know yet how to open bin file. Maybe I will study the MP code to figure out.

But wouldn’t it be a feature, which should be integrated in MP?
As (I think) many people are doing testflights on their property and thanks to google maps you can see in a minute where and how someone is living.

But as the GPS information is useful for pointing out failures its not an option to switch logging of.
So an offset would be best I guess.


(Thomas) #7

Well for my understanding I need to have something like a grid to encode the bin file, at which position is which parameter.
I was looking into the code directory “log” but I am not able to find anything descripted like bin2log converter.
Can anyone give me some hints where to find this?

What if I change the log file? Is everyone able to analize a uploaded log file or is bin nessecary?


(Fnoop) #8

Yes, that is correct if you’re creating a service that users will trust!

On one hand current dataviz implementations such as Maverick analysis will not display any inadvertently non-anonymised data (it only displays what has been designed in the dashboards), but the data will exist in the timeseries database which would be available if the system were ever hacked. So better to not import it in the first place, only import data that is specified and knowingly anonymised if relevant.


(Michael Oborne) #9

are you looking at just DF logs, or tlogs as well?


(Thomas) #10

I am new to this, so I don’t know how often you have to share tlogs.
My concern is only privacy. Not that I would want to hide something, but everyone can see where you are located and the net is full of sick people.
Just as a use case:
You upload a video by accident showing your neighbours preacious and rara car. Some one coud see this and easyly search for more data of you. Find a log and see where you are located…

I hope that one can understand my english. :sunglasses:


(Thomas) #11

I coded something… :face_with_raised_eyebrow:
I know it’s not pretty, but a first shot.

I would wish such an option in MP as a button "publish log"
Also I really miss the option to open parameter files with no FC connected. As I am new to this and reading a lot, I often wish to check how some specific setting is at my FC, but can just see into it with a text editor when I don’t have my FC with me. And there you won’t see the options this parameter has.

If someone is interested in this privacy thing, please feel free to give me some hints how to do it better… :sunglasses:

I know it’s not the whitelisted way…