Task Context - Skill Labeling
Our Study Posting in oDesk
The study was posted to oDesk.com (now upwork), here is a screenshotof how the job posting looked like when it was available:
Here is a look at the environment were participants could look at the task context:
http://cse.unl.edu:8181/ide.html
Back to top
Participant Background
P1 |
Some java game development |
Less than 5 years |
Novice |
P2 |
Some database applications |
Less than 5 years |
Novice |
P3 |
Technical software architect |
Between 5 and 10 years |
Experienced |
P4 |
Java SE developer |
Between 5 and 10 years |
Experienced |
P5 |
10 years of web and desktop apps |
More than 10 years |
Experienced |
P6 |
5 years in enterprise projects |
Between 5 and 10 years |
Experienced |
P7 |
Java EE + JSP apps |
Less than 5 years |
Novice |
P8 |
4 years of java experience in student projects |
Less than 5 years |
Novice |
Back to top
Gold Standard
Adapter |
Android |
Condition |
DialogFragment |
Event Handling |
GestureDetector |
GUI Layout |
HeadViewListAdapter |
Heap |
Inheritance |
Inner Classes |
List |
Maven |
Method Overloading |
Object Oriented |
Recursion |
SeekBar |
support.v4 |
SwipeLayout |
SwipeDetector |
SwipeListener |
View |
ViewDragHelper |
XML |
Back to top
Participant Responses
Labels from participants responses before aggregation.
Android Layout |
ArrayList |
Android |
ArrayList |
Android |
Android |
Android |
Android |
Enum |
Custom View |
Area Processing |
DialogFragment |
Collections |
Android View |
Array |
Conditions |
Gesture Detector |
Enum |
ArrayList |
HashMap |
Enum |
android.support.v4 |
Conditions |
Enum |
If-Else |
GestureDetector |
DialogFragment |
IllegalArgumentException |
Event Handling |
Apache Maven |
Conditions(if-else) |
Exception Handling |
instanceof |
HashMap |
Exception Handling |
IllegalStateException |
Flow Control Statements |
Event Handling |
Iterations over Array |
Gesture |
Java Collections |
List |
GUI Event Handling |
LayoutLib |
Function Overloading |
GUI Layouts |
Java Annotations |
GUI Layouts |
List |
Map |
HashMap |
ListView |
Java Generics |
Java Collections |
Java Collections |
Java Collections |
Map |
Seekbar |
Interfaces |
SwipeDenier |
Layout Manager |
Java Exceptions |
Java Documentation |
Java Documentation |
Maven |
support.v4 |
Java Clipboard API |
|
List |
Java Generics |
Java Enumeration |
Java Generics |
Method Overriding |
SurfaceView |
Java Collections |
|
Listener pattern |
List |
Java Generics |
Java Inheritance |
MotionEvent |
SwipeDenier |
Java Drag&Drop API |
|
Map |
Listeners |
Java Inheritance |
List |
onTouchEvent |
SwipeGesture |
Java Enumeration |
|
Maven |
Map |
Java Iterators |
Maven |
Seekbar |
SwipeListener |
Java Inheritance |
|
Object Oriented Programming |
Swipe Gesture |
List |
Method Overloading |
View |
View Binding |
Java Math |
|
support.v4 |
|
Map |
Object Oriented |
ViewGroup |
|
Java Swing API |
|
Swipe Gesture |
|
Maven |
SwipeLayout |
|
|
List |
|
|
|
Object |
|
|
ListView |
|
|
|
Swipe Gestures |
|
|
Map |
|
|
|
SwipeLayout |
|
|
Maven |
|
|
|
Throw Exception |
|
|
MotionEvent |
|
|
|
UI Interface |
|
|
Polymorphism |
|
|
|
|
|
|
Seekbar |
|
|
|
|
|
|
SwipeDenier |
|
|
|
|
|
|
SwipeGesture |
|
|
|
|
|
|
SwipeLayout |
|
|
|
|
|
|
Trigonometric Calculus |
|
|
|
|
Back to top
Label Aggregation
Groups of aggregated labels. Labels in italics refer to those found only in LDA
Conditions |
Conditions, If-Else, Flow Control Statements |
Denier |
Denier, SwipeDenier |
Enum |
Enum, Java Enumeration |
Event Handling |
Event Handling, MotionEvent, onTouchEvent, GUI Event Handling, UI Interface |
Exception Handling |
Exception Handling, IllegalStateException, try IllegalArgumentException, Throw Exception |
Gesture |
Gesture, GestureDetector, SwipeGesture, Swipe Gestures |
GUI Layout |
GUI Layout, LayoutLib, Layout Manager, computeSurfaceLayout, onLayout |
Iterators |
Java Iterators, Iteration over array |
Java Collections |
Java Collections, Map, ArrayList, HashMap (1) |
Java Inheritance |
Java Inheritance, Interfaces, Polymorphism |
Maven |
Maven, Apache Maven |
Method Overriding |
Method Overriding, Function Overload |
Object Oriented |
Object Oriented, Object |
support.v4 |
support.v4, android.support.v4, v4 |
SwipeListener |
SwipeListener, Listener, Listener Pattern, swipeable |
View |
View, ViewGroup, Custom View, SurfaceView, View Binding, ListView, AndroidView |
0 |
0, 1, 2 |
- the label List was not included since the Owner of the project classified it as a relevant label
Back to top
LDA Labels after aggregation
android |
android |
Event Handling |
Event Handling |
Drag & Drop |
- |
GUI Layout |
GUI Layout |
Inheritance |
- |
Java Collection |
Java Collection |
Method Overloading |
- |
SeekBar |
Seekbar |
support.v4 |
- |
SwipeLayout |
SwipeLayout |
SwipeListener |
SwipeListener |
View |
- |
xml |
- |
0 |
0 |
abs |
- |
add |
- |
angle |
- |
API |
- |
area |
- |
attrs |
- |
Boolean |
- |
Bottom |
- |
calculate |
- |
CANCEL |
- |
child |
- |
close |
- |
containsKey |
containsKey |
context |
- |
create |
- |
daimajia |
- |
Description |
- |
dispatch |
- |
distance |
- |
dp2px |
- |
dx |
- |
edge |
- |
entry |
- |
ev |
- |
Exception Handling |
Exception Handling |
fraction |
- |
getActionMasked |
getActionMasked |
getBottom |
getBottom |
getChildAt |
getChildAt |
getInt |
getInt |
getLeft |
getLeft |
getMeasured |
getMeasured |
getPadding |
getPadding |
getParent |
getParent |
getRaw |
getRaw |
getRootView |
getRootView |
getShowMode |
getShowMode |
getX |
- |
getY |
- |
guy |
- |
heightMeasureSpec |
heightMeasureSpec |
invalidate |
- |
java |
java |
latest |
- |
LayDown |
LayDown |
leftOffset |
leftOffset |
libraries |
- |
link |
- |
maintain |
- |
max |
max |
Middle |
- |
mode |
- |
morning |
- |
mShowEntirely |
- |
onOpen |
onOpen |
onUpdate |
onUpdate |
onViewPositionChanged |
onViewPositionChanged |
onViewReleased |
onViewReleased |
ordinal |
- |
Owner |
- |
parent |
- |
postInvalidateOnAnimation |
postInvalidateOnAnimation |
PullOut |
PullOut |
R |
- |
rect |
- |
remove |
- |
res |
- |
Return |
- |
Right |
- |
ShowMode |
ShowMode |
smooth |
- |
solution |
- |
specific |
- |
Status |
- |
styleable |
- |
suitable |
- |
super |
- |
suppose |
- |
surface |
- |
sX |
- |
sY |
- |
top |
- |
TypedArray |
TypedArray |
UP |
- |
User |
- |
using |
- |
util |
- |
values |
- |
via |
- |
Back to top