Deepdive
03 Jan 2017 | machine-learning probabilistic-modelsDeepdive is a factor graph. I think one of the coolest uses of Deepdive has been MEMEX, which tries to identify personal ads that correlate strongly with human trafficking.
Each deepdive application is broken down into 3 main things
app.ddlog
db.url
deepdive.conf
There are three folders in an app
input/
-> Stores all the input data for the application either in a *.tsj or a *.tsj.shrun/
-> Stores the run with a timestamp for all log and output filesudf/
-> Stores all the user defined functions refrenced in app.ddlog
More about the Math
- Explanation of Factor Graphs + Microsoft’s TrueSkill Algorithm
-
Explanation of Bayesian Statistics
- How factor graphs are used by deepdive
Written on January 3, 2017