Saturday 21 May 2011

Category Theory, Entropy and Information Theory

Just for reference, but this looks awfully relevant..

n-Category Cafe May 10, 2011 's entry: Entropies vs. Means (Tom Leinster) as a start, which then takes us to Entropy as a functor and specifically A characterization of entropy in terms of information loss.

This takes us neatly to Reyni's paper A. Rényi, Measures of information and entropy, in Proceedings of the 4th Berkeley Symposium on Mathematics, Statistics and Probability 1960, pp. 547–561.

The thesis being:

Given an ontology, we can calculate the entropy of a set of attributes/classes from that ontology, ie, the entropy of a function that selects a sub-set of that ontology. This is of course complicated by dependencies between attributes within that ontology, eg: star-sign <---> date-of-birth  etc.

For each sub-set we can construct a further set of functions that partition the ontology as above - thus creating a partial ordering of functions (and a semi-lattice where all functions can be ground to a bottom value by a function f O -> _|_ which effectively removes everything giving an entropy of 1, ie: pure randomness and loss of all information.

A privacy preserving function is one that introduces more entropy, ie: obfusicates or anonymised any data passing through. However, There are certain other properties that need to be investigated, such as aspects over the original ontology - not all information is PII etc. Does this imply some weighting in the entropy calculation or something more exotic such as a matrix structure.

This might fit in nicely with some earlier work on trajectories of information....

21 comments:

gowsalya said...

The knowledge of technology you have been sharing thorough this post is very much helpful to develop new idea. here by i also want to share this.
digital marketing training in marathahalli

digital marketing training in rajajinagar

Digital Marketing online training

full stack developer training in pune

full stack developer training in annanagar

Anonymous said...

The knowledge of technology you have been sharing thorough this post is very much helpful to develop new idea. here by i also want to share this.
full stack developer training in annanagar

full stack developer training in tambaram

full stack developer training in velachery

Mounika said...

Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article. thank you for sharing such a great blog with us.
python training institute in chennai
python training in Bangalore
python training institute in chennai

Unknown said...

Nice post. By reading your blog, i get inspired and this provides some useful information. Thank you for posting this exclusive post for our vision. 
Blueprism training in tambaram

Blueprism training in annanagar

Blueprism training in velachery

nilashri said...

I am sure this post has helped me save many hours of browsing other related posts just to find what I was looking for. Many thanks!

Data Science training in rajaji nagar
Data Science training in chennai
Data Science training in electronic city
Data Science training in USA
Data science training in pune
Data science training in kalyan nagar

Unknown said...

Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
java training in chennai

java training in marathahalli | java training in btm layout

Genga Savitha said...

Have you been thinking about the power sources and the tiles whom use blocks I wanted to thank you for this great read!! I definitely enjoyed every little bit of it and I have you bookmarked to check out the new stuff you post

angularjs Training in bangalore

angularjs Training in btm

angularjs Training in electronic-city

angularjs online Training

angularjs Training in marathahalli

Praylin S said...

Remarkable post! This is worth reading. Do share more.
LINUX Training in Chennai
LINUX Course in Chennai
Manual Testing Training in Chennai
Manual Testing Courses in Chennai
JavaScript Training in Chennai
JavaScript Course in Chennai
LINUX Training in T Nagar
LINUX Training in Velachery

sasitamil said...

That was a great message in my carrier, and It's wonderful commands like mind relaxes with understand words of knowledge by information's.

devops online training

aws online training

data science with python online training

data science online training

rpa online training

Ram Niwas said...
This comment has been removed by the author.
gautham said...

sql certification is a way to learn a sql course

kani said...

nice..
inplant training in chennai
inplant training in chennai
inplant training in chennai for it
hosting
india hosting
india web hosting
iran web hosting
technology 11 great image sites like imgur hosting
final year project dotnet server hacking what is web hosting
macao web hosting

shri said...

good post...!
internship in chennai for ece students
internships in chennai for cse students 2019
Inplant training in chennai
internship for eee students
free internship in chennai
eee internship in chennai
internship for ece students in chennai
inplant training in bangalore for cse
inplant training in bangalore
ccna training in chennai


Aruna said...

Excellent Articles are Represented here in this Site...I am Very Thankful for all the Writers...Keep it Up!!!
Java training in chennai | Java training in annanagar | Java training in omr | Java training in porur | Java training in tambaram | Java training in velachery

nisha said...

Nice Blog. the blog is really very Impressive. every concepts should be explained very neatly.every blog should be explained unique in the manner.

Data Science Training Course In Chennai | Data Science Training Course In Anna Nagar | Data Science Training Course In OMR | Data Science Training Course In Porur | Data Science Training Course In Tambaram | Data Science Training Course In Velachery

nisha said...

The Blog is really Informative.every content should be very neatly represented each and every concept should be unique.

Data Science Training Course In Chennai | Data Science Training Course In Anna Nagar | Data Science Training Course In OMR | Data Science Training Course In Porur | Data Science Training Course In Tambaram | Data Science Training Course In Velachery

nisha said...

The Blog is really Informative.every content should be very neatly represented each and every concept should be unique.

Data Science Training Course In Chennai | Data Science Training Course In Anna Nagar | Data Science Training Course In OMR | Data Science Training Course In Porur | Data Science Training Course In Tambaram | Data Science Training Course In Velachery

rocky said...

I love read this article. I like your blog.
Python Training in Chennai

Python Training in Training

Python Training in Bangalore
Python Hyderabad

Python Training in Coimbatore



Lavanya said...

I love read this article. I like your blog.salesforce training in chennai

software testing training in chennai

robotic process automation rpa training in chennai

blockchain training in chennai

devops training in chennai

rajmohan1140 said...

Stupendous blog huge applause to the blogger and hoping you to come up with such an extraordinary content in future.

Java Training in Chennai

Java Course in Chennai

trublogger said...

much obliged because of the reality you have been exact natured to rate assessment resulting to us. we can constantly perceive all you have completed here since I comprehend you are chosen stressed thoroughly considering our. Bitdefender Full Crack

cyberspc.com