Assuming that you are using UI.R, not the HTML user interface, you can use the HTMLor function for this tags.
Please keep in mind that I am writing this from the head, so the code is not verified.
HTML("<ul><li>...text...</li><li>...more text...</li></ul>")
or
tags$div(
tags$ul(
tags$li("text")
)
)
Update: First I missed the dynamic word in your question, so I only mentioned UI.R(thanks @StephaneLaurent for pointing it out).
, renderUI server.R. , , , HTML. UI.R, , uiOutput.
:
UI.R
uiOutput("myList")
server.R
output$myList <- renderUI(HTML("<ul><li>...text...</li><li>...more text...</li></ul>"))
renderUI docs tutorial.