apache spark - How to specify multiple python files in a PySpark application? -

-

i have pyspark app (one python file) something. submitting app spark using spark-submit , passing dependencies , jars manually (i not building uber jar).

but python file big , difficult manage, split multiple .py files under 1 package (working in pycharm). how specify these files @ spark-submit let know these files make application?

thanks in advance!


Comments

Post a Comment

Popular posts from this blog

java - unable show chart in xls document using jasper reports -

-
Image
i new jasper reports . able export data through jasper reports excel sheet. when created pie chart in ireports , showing on preview. when write below code in jsp file view report in jasperviewer , shows data along chart. when try save document (that in jasperviewer, gives many ways of saving report either in pdf or rtf or xls) xls error came in console net.sf.jasperreports.engine.jrexception: cell cannot added. however when remove chart .jrxml file, able export data excel file. read jr chart inserted image in excel document. xls document not taking images. below jsp file: <%@ page language="java" contenttype="text/html; charset=iso-8859-1" pageencoding="iso-8859-1" import="java.sql.*,java.util.*, net.sf.jasperreports.engine.*,java.io.*, net.sf.jasperreports.engine.design.*, net.sf.jasperreports.view.jasperviewer" %> <!doctype html public "-//w3c//dtd html 4.01 transitional//en" "http://www.w3.org/tr/html...
Read more

javascript - Slick Slider width recalculation -

-
i'm trying add slide in panel on slick container css. carousel works except new width not being calculated when space has been added. recalibrate once advance next slide i'd happen each time panel opened or closed. i've tried adding both margin , padding, neither makes difference. ideas? https://jsfiddle.net/mhigley/dpf7mlpl/ html: <button type="button" id="button"><i class="fa fa-arrow-right"></i></button> <aside> <h2>slide in panel</h2> <ol> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> </ol> </aside> <main role="main"> <div class="sections"> <section> <article> <h2>first slide</h2> <p>lorem ipsum d...
Read more

jsf - PrimeFaces Datatable - What is f:facet actually doing? -

-
looking through primefaces code in app noticed following line: <f:facet name="header">#{trainsearch.traincount} trains</f:facet> it looks overriding header, makes sense, can explain me in little more detail? what happening line of code? complete code listed below: <p:datatable id = "results" value = "#{trainsearch.trains}" var = "train" rendered="#{not empty trainsearch.trains}" styleclass = "train-search-table horizontal-border"> <f:facet name="header">#{trainsearch.traincount} trains</f:facet> <p:column headertext = "train id"> <p:panelgrid columns="1" styleclass = "train-id-grid" layout = "grid"> <h:outputtext styleclass = "train-id-label" value="#{train.traini}"/> <h:outputtex...
Read more