Not with the columns ui built-in tab stack, but with Tabbed Panel Stack mod (foo_uie_tabs).
http://foobar2000.com.cn/theo/projects/fb2k-0_9_6-ports/
Another way is to "create" your own tab stack in PSS:
Just place more panels at the same place and hide all panels except one as "hide on startup" or use global variables for show/hide a panel.
Simple Example:
$init_ps_global(panel,1)
$showpanel(Panel1,$ifequal(%panel%,1,1,0))
$showpanel(Panel2,$ifequal(%panel%,2,1,0))
$showpanel(Panel3,$ifequal(%panel%,3,1,0))
$showpanel(Panel4,$ifequal(%panel%,4,1,0))
$textbutton(10,10,50,20,PANEL1,PANEL1,SETGLOBAL:panel:1;REFRESH,fontcolor:0-0-0,fontcolor:255-0-0)
$textbutton(70,10,50,20,PANEL2,PANEL2,SETGLOBAL:panel:2;REFRESH,fontcolor:0-0-0,fontcolor:255-0-0)
$textbutton(130,10,50,20,PANEL3,PANEL3,SETGLOBAL:panel:3;REFRESH,fontcolor:0-0-0,fontcolor:255-0-0)
$textbutton(190,10,50,20,PANEL4,PANEL4,SETGLOBAL:panel:4;REFRESH,fontcolor:0-0-0,fontcolor:255-0-0)