Any reason to use Aggregate, not simpler string.Join?
string joined = string.Join(", ", myCollection.Select(x => "'" + x + "'"));
(add a call ToArrayif you are using .NET 3.5.)
string.Join Aggregate ( StringBuilder), . , , :
string csv = myCollection.Aggregate(new StringBuilder("'"),
(sb, x) => sb.AppendFormat("{0}', '"),
sb => { sb.Length -= 3;
return sb.ToString(); });