Trait

org.uclm.alarcos.rrc.io

ReaderRDF

Related Doc: package io

Permalink

trait ReaderRDF extends Serializable

Created by raulreguillo on 6/09/17.

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Known Subclasses
TripleReader
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReaderRDF
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def execute(): Unit

    Permalink

  2. abstract val processSparkSession: SparkSession

    Permalink
    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  8. def expandNodesNLevel(nodes: VertexRDD[Node], graph: Graph[Node, Node], levels: Int = 1): Dataset[Row]

    Permalink

    Returns a dataset of rows expanded by the number of levels given

    Returns a dataset of rows expanded by the number of levels given

    nodes

    VertexRDD of Nodes which are a subset of the Graph Nodes

    graph

    Spark GraphX of Nodes

    levels

    Number of levels to expand

    returns

    Dataset of Rows of expanded levels

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. def getSubjectsWithProperty(graph: Graph[Node, Node], property: String): VertexRDD[Node]

    Permalink

    Returns a VertexRDD of Nodes linked by the given property

    Returns a VertexRDD of Nodes linked by the given property

    graph

    Spark GraphX of Nodes

    property

    String of the property given

    returns

    VertexRDD of Nodes linked by the given property

  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  14. def loadGraph(session: SparkSession, path: String): Graph[Node, Node]

    Permalink

    Main method for load the graph from a path

    Main method for load the graph from a path

    session

    Spark session

    path

    Path of the NT files to read. Could be a local, HDFS, S3 path

    returns

    Spark GraphX of Nodes

  15. def loadObjects(session: SparkSession, path: String): RDD[Node]

    Permalink

    Returns all the distinct objects in the file (but not the subjects or predicates)

    Returns all the distinct objects in the file (but not the subjects or predicates)

    session

    Spark session

    path

    Path of the NT files to read. Could be a local, HDFS, S3 path

    returns

    RDD of Nodes which are objects in the files

  16. def loadPredicates(session: SparkSession, path: String): RDD[Node]

    Permalink

    Returns all the distinct predicates in the file

    Returns all the distinct predicates in the file

    session

    Spark session

    path

    Path of the NT files to read. Could be a local, HDFS, S3 path

    returns

    RDD of Nodes which are predicates in the files

  17. def loadSubjects(session: SparkSession, path: String): RDD[Node]

    Permalink

    Returns all the subjects in the file (but not the objects or predicates)

    Returns all the subjects in the file (but not the objects or predicates)

    session

    Spark session

    path

    Path of the NT files to read. Could be a local, HDFS, S3 path

    returns

    RDD of Nodes which are subjects in the files

  18. def loadTriplets(sparkSession: SparkSession, path: String): RDD[Triple]

    Permalink

    Load the triplets initially

    Load the triplets initially

    sparkSession

    Spark session

    path

    Path of the NT files to read. Could be a local, HDFS, S3 path

    returns

    RDD of Triples {subject, predicate, object}

  19. val log: Logger

    Permalink
    Attributes
    protected

  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  23. def showTripletsRDD(tripletsRDD: RDD[Triple]): Unit

    Permalink

    Prints the current RDD of Triples Warning: this method needs to collect the RDD

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def Dep_getSubjectsWithProperty(graph: Graph[Node, Node], property: String): VertexRDD[Node]

    Permalink
    Annotations
    @deprecated
    Deprecated

  2. def expandNodes(nodes: VertexRDD[Node], graph: Graph[Node, Node]): VertexRDD[Node]

    Permalink
    Annotations
    @deprecated
    Deprecated

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped