make the method show() print the results

[djouallah]

for a compatibility with spark and Duckdb , can you please make ctx.sql('select 42').show() print the results please.

btw, version 8 is a very solid improvement !!!

[simicd]

Hi @djouallah, thanks for reporting the issue and the feedback! I tried to reproduce the problem. When debugging in e.g. VS Code and run ctx.sql("SELECT 42").show() the result is not printed in the debug console but by default in the terminal. This is due to VS Code's debug settings:

Debug console

Terminal

I assume you'd like to show terminal outputs in the debug console. If that's the case you'd need to set the VS Code config to internal console in .vscode/launch.json as follows:

{
    // Use IntelliSense to learn about possible attributes.
    // Hover to view descriptions of existing attributes.
    // For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
    "version": "0.2.0",
    "configurations": [
        {
            "name": "Python: Debug",
            "type": "python",
            "request": "launch",
            "program": "${file}",
            "console": "internalConsole",
          }
    ]
}

Once that's set both .show() will be printed in the same console:

This is assuming that you're using VS Code, chances are that if you're using another editor you will have similar possibilty to configure the output. Hope that helps, please feel free to share additional context if this is not what you were looking for

[djouallah]

tried this in colab

why duckdb and pyspark works out of the box, can you do the same as they are doing ?

[simicd]

Thanks for the hint & additional context @djouallah, I was able to reproduce this in Jupyter notebooks now. I will take a look at how duckdb & PySpark are implementing the method In the meantime you can just drop .show() to preview the dataframe until the root cause of the issue is found: