Investigating the effect of different tree decompositions on graph grammars.
-
Tree decomposition Generate a tree decomposition using "minf" variable elimination algorithm
./tredec.dimacs.tree.py --orig datasets/out.contact --peoh minf
-
Treewidth Print treewidth & compute a tree decomposition given the variable elimination using flag:
varel
./tredec.dimacs.tree.py --orig datasets/out.contact -peoh minf -tw
-
Generate HRG graphs from the tree decomposition (
.dimacs.tree
file) generated in one of the above steps../tredec.phrg.py --orig datasets/out.contact --clqtree datasets/contact_minf.dimacs.tree
-
xPHRG treewidth (tw) ``
-
Jaccard Sim
python td.isom_jaccard_sim.py --orig /data/saguinag/datasets/les_Mis/moreno_lesmis/out.moreno_lesmis_lesmis --pathfrag datasets/moreno_lesmis_lesmis
For batch generation, use this on dsg1:
cat tdec/maindatasets | parallel tdec/exp.jaccard.sh {}
-
Batch processing on DSG1: Tree decompositions:
tdec/exp.linux.sh datasets/out.contact
HRG graph geneation:tdec/exp.metrics.sh datasets/out.contact
Jaccard Similarity:./tredec.isomorph_dimacs_tree.py --orig datasets/out.contact --pathfrag datasets/contact_
Jaccard Similarity b/w pairs of Production Rules from each of the Tree decomposition heuristics.
- http://stackoverflow.com/questions/11911252/python-jaccard-distance-using-word-intersection-but-not-character-intersection
- Jaccard Similarity
python interxn.py Results/moreno_vdb_vdb_isom_in ## terxn.bz2 moreno_vdb_vdb
With this line we can generate stats on a given group of production rulespython isomorph_overlap_hl.py --orig ~/KynKon/datasets/out.karate_club_graph --pathfrag ../ProdRules/karate_club_graph
This file: rndmSubgSamp.py
is doing a lot of the heavy lifting.
This will generate all *prs files needed, then I can seprately run the analysis of
orig vs hStars and then look at the Union and Isomorphic ovelaps.
[TODO] Tweak and otpimize the UnionPlusIsomorphic Intersection
python tredec.dimacs.tree.py --orig ~/Theory/DataSets/out.subelj_euroroad_euroroad --peoh mcs
python tredec.samp.phrg.py --orig ~/Theory/DataSets/out.subelj_euroroad_euroroad --tree datasets/subelj_euroroad_euroroad
find ~/KynKon/datasets -name 'out.*' -type f | parallel python core/cc_in_ds.py {}
Returns:
LCC, |V|: 1226 in 1 total: out.maayan-faa
LCC, |V|: 1615 in 43 total: out.maayan-Stelzl
LCC, |V|: 6474 in 1 total: out.as20000102
LCC, |V|: 160 in 19 total: out.maayan-pdzbase
LCC, |V|: 224832 in 15836 total: out.email-EuAll
- Download the datasets; run script
download_datasets.sh
for details
- Control 551 python exact_phrg.py --orig datasets/out.ucidata-gama 553 python tstprodrules.py --prs ProdRules/ucidata-gama_prs.tsv --orig datasets/out.ucidata-gama 555 python explodingTree.py --orig datasets/out.ucidata-gama 558 ls -1 ProdRules/* | parallel python tstprodrules.py --prs {} --orig datasets/out.ucidata-gama
from paramiko import SSHClient
client = SSHClient()
client.load_system_host_keys()
client.connect("hostname", username="user")
stdin, stdout, stderr = client.exec_command('program')
print "stderr: ", stderr.readlines()
print "pwd: ", stdout.readlines()
Date | Notes |
---|---|
10May17 | intrxn tweaked to handle any input dataset |
02May17 | xphrg tw print for any input => integrated into exact.phrg.py |
| Need to work on isomorphoids
07Apr17| Working on refactoring the files to make it more usable; fixing issues with sampling; ToDo: process mult trees from sampling
06Apr17| tree decomposition: 'fails here' issue of strange d[x]
03Apr17| Got the isomorph working nees tuning; ToDo: Sampling: sampled.subgraphs.cliquetree.py
03Apr17| isomorphic prod rules check; (1) within a set and (2) between sets; TODO: zoom in on zachary lexm and mcsm iso overlap; within file, using iso check, use the resluting set to build graphs
30Mar17| Looking at overlaps using isomorphism
29Mar17| Work on the overlap data; the sampling is not working out so easily
28Mar17| Try sampling smaller graphs and reference the original sample_edgelist_tosubgraphs.py
27Mar17| The sampled graphs need to handle the node ids being much Larger than V.size
19Mar17| Need to make sure the conversion to binarized tree works okay
08Mar16| plot/show the progression from the BoardExample file to the binarized version and test other graphs
17Mar17| The workflow:
29Jan17| dimacs_td_ct
ToDo: TD to Prod Rules from NDDGO
17Jan17| INDDGO - Baseline TD plotting; Compute Network Statistics gen_cliquetree
has issues for "set changed size during iteration" The problem is with RuntimeError: Set changed size during iteration
12Jan17| ToDo: TD to Prod Rules from NDDGO
07Jan17| Done: python call to generate hrg (hstar) graph objects
10Jan17| ToDo: python call to generate kron graphs (??)
11Jan17| Figure out how to take a TD from inddgo and derive a set of production rules
11Jan17| Expand related work & experiments
10May17 | exact.phrg.py can samp subgs, deriv pr, graph gen synth of same size as the original
12May17 | working on geting the stacked prod rules
12May17 | Just need the isomorphic overlap
14May17 | Need to fix, the Jaccard sim routine
14May17 | Need to fix, the Jaccard sim routine
15May17 | rand graph stats using tst-rand_gstats
15May17 | Do a BA rand graph to HRG hstars control test
19May17 | reading the rules have make sure that RHS is a list
22May17 | re-doing the experiments with as routers
23May17 | Are BA gen graphs written to edgelist?
23May17 | td_rndGStats.py
26May17 | 817 python td_rndGraphs.py --bam 818 python td_rndGStats.py
28May17 | td_rndGStats.py", line 219, in graph_gen_isom_interxn num_nodes = int(fbname.split("_")[1].strip(".tsv"))
30May17 | can the var elim prules (ProdRules/ucidata-gama.lexm_prules.bz2) generate graphs?
30May17 | lesmis is good all the way
30May17 | try stacked on les mis
31May17 | Test .... if each rhs is not in lhs ... we cannot fire (?)
06Jun17 | Test on dsg1
06Jun17 | Work on tests
18Jun17 | python explodingTree.py --orig datasets/out.ucidata-gama
18Jun17 | python tstprodrules.py --prs Results/ucidata-gama_isom_interxn.tsv --orig datasets/out.ucidata-gama
19Jun17 | explodingTree: todo sample large graphs (ref_graph_largest_conn_componet)
22Jun17 | Holme et al 2012 and 2015 comprehensive temproal analysis of graphs
22Jun17 | Mealinie Weber curvature for networks
22Jun17 | olivia richie curvature
11Jul17 | Can it fire?
11Jul17 | b1eb6f2..7cad731 is a commit version that works
12Jul17 | Sampling I think might be working
01Aug17 | To do Check that the isom subset of rules will fire
18Sep17 | Do nothing if file exists
18Sep17 | bb3D.py next: .tree x var els
19Sep17 | fix this: File "bb3D.py", line 76, in
20Sep17 | got the prs generation working
22Sep17 | got to do base info dict to disk and read if exists
22Sep17 | Fire or not (debugging required)
22Sep17 | Test intersectin (isomorphic) production rules subset
26Sep17 | I think the probs are being computed correctly now
26Sep17 | pwd
28Sep17 | probe_stacked_prs_likelihood_tofire
20Nov17 | cc_in_ds.py identify what cc are in each graph
04Dec17 | test
04Dec17 | re index and recount vertices in converting to dimacs
30Dec17 | fix tree_2cliquetree to get prs