Automatic Core-Developer Identification on GitHub:
A Validation Study

Back to main page


RQ3: Which metrics and network-construction methods are most accurate in classifying developers into core and peripheral?

Distribution of the ranks of the classification methods (using median F1 score per project)

Jump to results for
unsimplified, undirected, all contributors
unsimplified, directed, all contributors
simplified, undirected, all contributors
simplified, directed, all contributors
unsimplified, undirected, code contributors
unsimplified, directed, code contributors
simplified, undirected, code contributors
simplified, directed, code contributors

Networks: unsimplified, undirected, all contributors
Accuracy assessment based on privileged events
rank-distributions-unsimplified-undirected-allcontributors-privileged-3months
rank-distributions-unsimplified-undirected-allcontributors-privileged-6months
rank-distributions-unsimplified-undirected-allcontributors-privileged-9months
rank-distributions-unsimplified-undirected-allcontributors-privileged-12months
rank-distributions-unsimplified-undirected-allcontributors-privileged-3months-sliding
rank-distributions-unsimplified-undirected-allcontributors-privileged-6months-sliding
rank-distributions-unsimplified-undirected-allcontributors-privileged-9months-sliding
rank-distributions-unsimplified-undirected-allcontributors-privileged-12months-sliding

Jump to top of page | results

Networks: unsimplified, directed, all contributors
Accuracy assessment based on privileged events
rank-distributions-unsimplified-directed-allcontributors-privileged-3months
rank-distributions-unsimplified-directed-allcontributors-privileged-6months
rank-distributions-unsimplified-directed-allcontributors-privileged-9months
rank-distributions-unsimplified-directed-allcontributors-privileged-12months
rank-distributions-unsimplified-directed-allcontributors-privileged-3months-sliding
rank-distributions-unsimplified-directed-allcontributors-privileged-6months-sliding
rank-distributions-unsimplified-directed-allcontributors-privileged-9months-sliding
rank-distributions-unsimplified-directed-allcontributors-privileged-12months-sliding

Jump to top of page | results

Networks: simplified, undirected, all contributors
Accuracy assessment based on privileged events
rank-distributions-simplified-undirected-allcontributors-privileged-3months
rank-distributions-simplified-undirected-allcontributors-privileged-6months
rank-distributions-simplified-undirected-allcontributors-privileged-9months
rank-distributions-simplified-undirected-allcontributors-privileged-12months
rank-distributions-simplified-undirected-allcontributors-privileged-3months-sliding
rank-distributions-simplified-undirected-allcontributors-privileged-6months-sliding
rank-distributions-simplified-undirected-allcontributors-privileged-9months-sliding
rank-distributions-simplified-undirected-allcontributors-privileged-12months-sliding

Jump to top of page | results

Networks: simplified, directed, all contributors
Accuracy assessment based on privileged events
rank-distributions-simplified-directed-allcontributors-privileged-3months
rank-distributions-simplified-directed-allcontributors-privileged-6months
rank-distributions-simplified-directed-allcontributors-privileged-9months
rank-distributions-simplified-directed-allcontributors-privileged-12months
rank-distributions-simplified-directed-allcontributors-privileged-3months-sliding
rank-distributions-simplified-directed-allcontributors-privileged-6months-sliding
rank-distributions-simplified-directed-allcontributors-privileged-9months-sliding
rank-distributions-simplified-directed-allcontributors-privileged-12months-sliding

Jump to top of page | results

Networks: unsimplified, undirected, code contributors
Accuracy assessment based on privileged events
rank-distributions-unsimplified-undirected-codecontributors-privileged-3months
rank-distributions-unsimplified-undirected-codecontributors-privileged-6months
rank-distributions-unsimplified-undirected-codecontributors-privileged-9months
rank-distributions-unsimplified-undirected-codecontributors-privileged-12months
rank-distributions-unsimplified-undirected-codecontributors-privileged-3months-sliding
rank-distributions-unsimplified-undirected-codecontributors-privileged-6months-sliding
rank-distributions-unsimplified-undirected-codecontributors-privileged-9months-sliding
rank-distributions-unsimplified-undirected-codecontributors-privileged-12months-sliding

Jump to top of page | results

Networks: unsimplified, directed, code contributors
Accuracy assessment based on privileged events
rank-distributions-unsimplified-directed-codecontributors-privileged-3months
rank-distributions-unsimplified-directed-codecontributors-privileged-6months
rank-distributions-unsimplified-directed-codecontributors-privileged-9months
rank-distributions-unsimplified-directed-codecontributors-privileged-12months
rank-distributions-unsimplified-directed-codecontributors-privileged-3months-sliding
rank-distributions-unsimplified-directed-codecontributors-privileged-6months-sliding
rank-distributions-unsimplified-directed-codecontributors-privileged-9months-sliding
rank-distributions-unsimplified-directed-codecontributors-privileged-12months-sliding

Jump to top of page | results

Networks: simplified, undirected, code contributors
Accuracy assessment based on privileged events
rank-distributions-simplified-undirected-codecontributors-privileged-3months
rank-distributions-simplified-undirected-codecontributors-privileged-6months
rank-distributions-simplified-undirected-codecontributors-privileged-9months
rank-distributions-simplified-undirected-codecontributors-privileged-12months
rank-distributions-simplified-undirected-codecontributors-privileged-3months-sliding
rank-distributions-simplified-undirected-codecontributors-privileged-6months-sliding
rank-distributions-simplified-undirected-codecontributors-privileged-9months-sliding
rank-distributions-simplified-undirected-codecontributors-privileged-12months-sliding

Jump to top of page | results

Networks: simplified, directed, code contributors
Accuracy assessment based on privileged events
rank-distributions-simplified-directed-codecontributors-privileged-3months
rank-distributions-simplified-directed-codecontributors-privileged-6months
rank-distributions-simplified-directed-codecontributors-privileged-9months
rank-distributions-simplified-directed-codecontributors-privileged-12months
rank-distributions-simplified-directed-codecontributors-privileged-3months-sliding
rank-distributions-simplified-directed-codecontributors-privileged-6months-sliding
rank-distributions-simplified-directed-codecontributors-privileged-9months-sliding
rank-distributions-simplified-directed-codecontributors-privileged-12months-sliding

Jump to top of page | results