Utils

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. val SNOWFLAKE_SOURCE_NAME: String

   Literal to be used with the Spark DataFrame's .

   Literal to be used with the Spark DataFrame's .format method

7. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8. def assertThatFileSystemIsNotS3BlockFileSystem(uri: URI, hadoopConfig: Configuration): Unit

   Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem.

   Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem. spark-snowflakedb cannot use this FileSystem because the files written to it will not be readable by Snowflake (and vice versa).

9. def checkThatBucketHasObjectLifecycleConfiguration(tempDir: String, s3Client: AmazonS3Client): Unit

   Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files.

   Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files. If no applicable configuration is found, this method logs a helpful warning for the user.

10. def classForName(className: String): Class[_]

11. def clone(): AnyRef

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

12. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

13. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

14. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

15. def fixS3Url(url: String): String

    Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads.

    Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads. This function converts the URL back to the s3:// format.

16. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

17. def getJDBCConnection(params: Map[String, String]): Connection

18. def getLastSelect: String

19. def hashCode(): Int

    Definition Classes

    AnyRef → Any

20. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

21. def joinUrls(a: String, b: String): String

    Joins prefix URL a to path suffix b, and appends a trailing /, in order to create a temp directory path for S3.

22. def makeTempPath(tempRoot: String): String

    Creates a randomly named temp directory path for intermediate data

23. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

24. final def notify(): Unit

    Definition Classes

    AnyRef

25. final def notifyAll(): Unit

    Definition Classes

    AnyRef

26. def printQuery(params: Map[String, String], query: String): Unit

27. def readMapFromFile(sc: SparkContext, file: String): Map[String, String]

28. def readMapFromString(string: String): Map[String, String]

    Same as readMapFromFile, but accepts the file content as an argument

29. def removeCredentialsFromURI(uri: URI): URI

    Returns a copy of the given URI with the user credentials removed.

30. def runQuery(params: Map[String, String], query: String): ResultSet

31. def sanitizeQueryText(q: String): String

    Removes (hopefully :)) sensitive content from a query string

32. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

33. def toString(): String

    Definition Classes

    AnyRef → Any

34. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

35. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

36. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )