BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/Chicago
X-LIC-LOCATION:America/Chicago
BEGIN:DAYLIGHT
TZOFFSETFROM:-0600
TZOFFSETTO:-0500
TZNAME:CDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0500
TZOFFSETTO:-0600
TZNAME:CST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20190731T213557Z
LOCATION:Crystal Foyer and Crystal B
DTSTART;TZID=America/Chicago:20190730T183000
DTEND;TZID=America/Chicago:20190730T203000
UID:pearc_PEARC19_sess157_stu_pos122@linklings.com
SUMMARY:Flexible Partitioning of Scientific Workflows Using the JX Workflo
 w Language
DESCRIPTION:Flexible Partitioning of Scientific Workflows Using the JX Wor
 kflow Language\n\nShaffer, Kremer-Herman, Thain\n\nScientific workflows ar
 e typically expressed as a graph of logical tasks, each one representing a
  single program along with its input and output files. A conventional work
 flow manager transforms each logical task into a discrete batch job and su
 bmits it to an underlying execution system. However, converting every logi
 cal task into one batch job is not necessarily the most efficient partitio
 ning of a workflow. By grouping multiple logical tasks into a single batch
  job, we may decrease data transfer, increase system utilization, and redu
 ce the execution time of a workflow. This paper presents JX (JSON eXtended
 ), a declarative language that can express complex workloads as an assembl
 y of sub-graphs that can be partitioned in flexible ways. We present a cas
 e study of using JX to represent complex workflows for the Lifemapper biod
 iversity project. We evaluate partitioning approaches across several compu
 ting environments, including HTCondor at the University of Notre Dame, TAC
 C Stampede2, and SDSC Comet, and show that a coarse partitioning results i
 n faster turnaround times, reduced data transfer, and lower master utiliza
 tion across all three systems.\n\nPosters\nReception, Poster, Student Post
 er
URL:https://pearc19.conference-program.com/presentation/?id=stu_pos122&ses
 s=sess157
END:VEVENT
END:VCALENDAR

