Automatic Core-Developer Identification on GitHub: A Validation Study

RQ₂: Is the set of privileged developers D_priv a sound approximation for the set of core developers?

Validity of our set of core developers

D_doc: documented developers in a project-reported list
D_priv: privileged developers (core developers based on privileged events)
D_priv+: privileged+extended developers (core developers based on privileged and extended events)

3 months time-window	Angular	Electron	Keras	Kubernetes	Moby	Next.js	Node.js	OpenSSL	React	reveal.js	Vue	webpack
\|D_doc\|	30	17	5	238	21	6	108	18	9	1	3	4
\|D_priv\|	18	10	3	30	9	20	26	9	9	0	3	5
\|D_priv+\|	35	19	7	611	9	22	53	174	208	1	3	6
JaccardIndex(D_doc, D_priv)	0.37	0.59	0.60	0.06	0.36	0.04	0.23	0.50	0.50	0.00	0.20	0.29
Completeness(D_priv \| D_doc)	0.43	0.59	0.60	0.06	0.38	0.17	0.23	0.50	0.67	0.00	0.33	0.50
Soundness(D_priv \| D_doc)	0.72	1.00	1.00	0.47	0.89	0.05	0.96	1.00	0.67	---	0.33	0.40
JaccardIndex(D_doc, D_priv₊)	0.51	0.71	0.33	0.10	0.36	0.04	0.41	0.10	0.03	0.00	0.20	0.25
Completeness(D_priv+ \| D_doc)	0.73	0.88	0.60	0.32	0.38	0.17	0.44	0.94	0.78	0.00	0.33	0.50
Soundness(D_priv+ \| D_doc)	0.63	0.79	0.43	0.12	0.89	0.05	0.89	0.10	0.03	0.00	0.33	0.33
6 months time-window	Angular	Electron	Keras	Kubernetes	Moby	Next.js	Node.js	OpenSSL	React	reveal.js	Vue	webpack
\|D_doc\|	30	17	5	238	21	6	108	18	9	1	3	4
\|D_priv\|	20	12	5	51	9	25	34	11	10	1	3	6
\|D_priv+\|	40	22	10	1125	9	27	63	199	392	2	3	7
JaccardIndex(D_doc, D_priv)	0.43	0.61	0.43	0.08	0.36	0.03	0.29	0.53	0.46	1.00	0.20	0.25
Completeness(D_priv \| D_doc)	0.50	0.65	0.60	0.09	0.38	0.17	0.30	0.56	0.67	1.00	0.33	0.50
Soundness(D_priv \| D_doc)	0.75	0.92	0.60	0.43	0.89	0.04	0.94	0.91	0.60	1.00	0.33	0.33
JaccardIndex(D_doc, D_priv+)	0.49	0.63	0.25	0.08	0.36	0.03	0.50	0.09	0.02	0.50	0.20	0.22
Completeness(D_priv+ \| D_doc)	0.77	0.88	0.60	0.44	0.38	0.17	0.53	0.94	0.78	1.00	0.33	0.50
Soundness(D_priv+ \| D_doc)	0.58	0.68	0.30	0.09	0.89	0.04	0.90	0.09	0.02	0.50	0.33	0.29
9 months time-window	Angular	Electron	Keras	Kubernetes	Moby	Next.js	Node.js	OpenSSL	React	reveal.js	Vue	webpack
\|D_doc\|	30	17	5	238	21	6	108	18	9	1	3	4
\|D_priv\|	23	13	12	61	9	32	36	11	17	1	3	6
\|D_priv+\|	46	24	19	1630	12	181	73	134	629	2	6	7
JaccardIndex(D_doc, D_priv)	0.47	0.58	0.42	0.09	0.36	0.03	0.31	0.53	0.30	1.00	0.20	0.25
Completeness(D_priv \| D_doc)	0.57	0.65	1.00	0.10	0.38	0.17	0.31	0.56	0.67	1.00	0.33	0.50
Soundness(D_priv \| D_doc)	0.74	0.85	0.42	0.39	0.89	0.03	0.94	0.91	0.35	1.00	0.33	0.33
JaccardIndex(D_doc, D_priv+)	0.46	0.58	0.26	0.07	0.38	0.01	0.60	0.12	0.01	0.50	0.29	0.22
Completeness(D_priv+ \| D_doc)	0.80	0.88	1.00	0.50	0.43	0.17	0.63	0.89	0.78	1.00	0.67	0.50
Soundness(D_priv+ \| D_doc)	0.52	0.63	0.26	0.07	0.75	0.01	0.93	0.12	0.01	0.50	0.33	0.29
12 months time-window	Angular	Electron	Keras	Kubernetes	Moby	Next.js	Node.js	OpenSSL	React	reveal.js	Vue	webpack
\|D_doc\|	30	17	5	238	21	6	108	18	9	1	3	4
\|D_priv\|	24	13	18	69	19	26	41	11	19	1	4	6
\|D_priv+\|	53	25	25	2019	22	29	79	199	736	2	9	7
JaccardIndex(D_doc, D_priv)	0.46	0.58	0.28	0.10	0.43	0.03	0.35	0.53	0.27	1.00	0.17	0.25
Completeness(D_priv \| D_doc)	0.57	0.64	1.00	0.11	0.57	0.17	0.36	0.56	0.67	1.00	0.33	0.50
Soundness(D_priv \| D_doc)	0.71	0.85	0.28	0.39	0.63	0.03	0.95	0.91	0.32	1.00	0.25	0.33
JaccardIndex(D_doc, D_priv+)	0.43	0.56	0.20	0.06	0.43	0.03	0.61	0.09	0.01	0.50	0.33	0.22
Completeness(D_priv+ \| D_doc)	0.83	0.88	1.00	0.54	0.62	0.17	0.66	0.94	0.78	1.00	1.00	0.50
Soundness(D_priv+ \| D_doc)	0.47	0.60	0.20	0.06	0.59	0.03	0.90	0.09	0.01	0.50	0.33	0.29

Jump to top of page | results