9:30 AM Saturday Room: Chin Wagger
With leap years and varying rules by Locale, time processing has proven tricky to get right on the JVM platform. This session will provide a very quick refresher of Unix epoch-based time keeping, time string formats and Locales, and then move to a discussion of time and date processing functions in Spark SQL, and the particular problems associated with making time window-based aggregations work as expected. As a fairly advanced session we will assume familiarity with Spark and will not go over any aspects of its architecture.