Task Context - Skill Labeling

Our Study Posting in oDesk

The study was posted to oDesk.com (now upwork), here is a screenshotof how the job posting looked like when it was available:

Here is a look at the environment were participants could look at the task context:

http://cse.unl.edu:8181/ide.html

Back to top

Participant Background

Partipant Experience Years Classification
P1 Some java game development Less than 5 years Novice
P2 Some database applications Less than 5 years Novice
P3 Technical software architect Between 5 and 10 years Experienced
P4 Java SE developer Between 5 and 10 years Experienced
P5 10 years of web and desktop apps More than 10 years Experienced
P6 5 years in enterprise projects Between 5 and 10 years Experienced
P7 Java EE + JSP apps Less than 5 years Novice
P8 4 years of java experience in student projects Less than 5 years Novice

Back to top

Gold Standard

Label
Adapter
Android
Condition
DialogFragment
Event Handling
GestureDetector
GUI Layout
HeadViewListAdapter
Heap
Inheritance
Inner Classes
List
Maven
Method Overloading
Object Oriented
Recursion
SeekBar
support.v4
SwipeLayout
SwipeDetector
SwipeListener
View
ViewDragHelper
XML

Back to top

Participant Responses

Labels from participants responses before aggregation.

P1 P2 P3 P4 P5 P6 P7 P8
Android Layout ArrayList Android ArrayList Android Android Android Android
Enum Custom View Area Processing DialogFragment Collections Android View Array Conditions
Gesture Detector Enum ArrayList HashMap Enum android.support.v4 Conditions Enum
If-Else GestureDetector DialogFragment IllegalArgumentException Event Handling Apache Maven Conditions(if-else) Exception Handling
instanceof HashMap Exception Handling IllegalStateException Flow Control Statements Event Handling Iterations over Array Gesture
Java Collections List GUI Event Handling LayoutLib Function Overloading GUI Layouts Java Annotations GUI Layouts
List Map HashMap ListView Java Generics Java Collections Java Collections Java Collections
Map Seekbar Interfaces SwipeDenier Layout Manager Java Exceptions Java Documentation Java Documentation
Maven support.v4 Java Clipboard API List Java Generics Java Enumeration Java Generics
Method Overriding SurfaceView Java Collections Listener pattern List Java Generics Java Inheritance
MotionEvent SwipeDenier Java Drag&Drop API Map Listeners Java Inheritance List
onTouchEvent SwipeGesture Java Enumeration Maven Map Java Iterators Maven
Seekbar SwipeListener Java Inheritance Object Oriented Programming Swipe Gesture List Method Overloading
View View Binding Java Math support.v4 Map Object Oriented
ViewGroup Java Swing API Swipe Gesture Maven SwipeLayout
List Object
ListView Swipe Gestures
Map SwipeLayout
Maven Throw Exception
MotionEvent UI Interface
Polymorphism
Seekbar
SwipeDenier
SwipeGesture
SwipeLayout
Trigonometric Calculus

Back to top

Label Aggregation

Groups of aggregated labels. Labels in italics refer to those found only in LDA

Aggregated as Labels
Conditions Conditions, If-Else, Flow Control Statements
Denier Denier, SwipeDenier
Enum Enum, Java Enumeration
Event Handling Event Handling, MotionEvent, onTouchEvent, GUI Event Handling, UI Interface
Exception Handling Exception Handling, IllegalStateException, try IllegalArgumentException, Throw Exception
Gesture Gesture, GestureDetector, SwipeGesture, Swipe Gestures
GUI Layout GUI Layout, LayoutLib, Layout Manager, computeSurfaceLayout, onLayout
Iterators Java Iterators, Iteration over array
Java Collections Java Collections, Map, ArrayList, HashMap (1)
Java Inheritance Java Inheritance, Interfaces, Polymorphism
Maven Maven, Apache Maven
Method Overriding Method Overriding, Function Overload
Object Oriented Object Oriented, Object
support.v4 support.v4, android.support.v4, v4
SwipeListener SwipeListener, Listener, Listener Pattern, swipeable
View View, ViewGroup, Custom View, SurfaceView, View Binding, ListView, AndroidView
0 0, 1, 2
  1. the label List was not included since the Owner of the project classified it as a relevant label

Back to top

LDA Labels after aggregation

Labels v1 (w/o stopwords) Labels v2 (after filtering)
android android
Event Handling Event Handling
Drag & Drop -
GUI Layout GUI Layout
Inheritance -
Java Collection Java Collection
Method Overloading -
SeekBar Seekbar
support.v4 -
SwipeLayout SwipeLayout
SwipeListener SwipeListener
View -
xml -
0 0
abs -
add -
angle -
API -
area -
attrs -
Boolean -
Bottom -
calculate -
CANCEL -
child -
close -
containsKey containsKey
context -
create -
daimajia -
Description -
dispatch -
distance -
dp2px -
dx -
edge -
entry -
ev -
Exception Handling Exception Handling
fraction -
getActionMasked getActionMasked
getBottom getBottom
getChildAt getChildAt
getInt getInt
getLeft getLeft
getMeasured getMeasured
getPadding getPadding
getParent getParent
getRaw getRaw
getRootView getRootView
getShowMode getShowMode
getX -
getY -
guy -
heightMeasureSpec heightMeasureSpec
invalidate -
java java
latest -
LayDown LayDown
leftOffset leftOffset
libraries -
link -
maintain -
max max
Middle -
mode -
morning -
mShowEntirely -
onOpen onOpen
onUpdate onUpdate
onViewPositionChanged onViewPositionChanged
onViewReleased onViewReleased
ordinal -
Owner -
parent -
postInvalidateOnAnimation postInvalidateOnAnimation
PullOut PullOut
R -
rect -
remove -
res -
Return -
Right -
ShowMode ShowMode
smooth -
solution -
specific -
Status -
styleable -
suitable -
super -
suppose -
surface -
sX -
sY -
top -
TypedArray TypedArray
UP -
User -
using -
util -
values -
via -

Back to top