Thursday, 27 October 2016

Splitting strings in MS Excel without regular expressions

Consider a field in Excel that contains a number followed by a '\' character, followed by 3 letters.

For example: 123456789\ABC

No let us say that you would like to get the part of the string that exists before or after the '\' character into another field.

You could write a VBA script that uses regular expressions, but this can more easily be achieved using a combination of the RIGHT, LEFT, LEN and FIND methods.

Tuesday, 11 October 2016

T-SQL: The STUFF method, inserting characters to a varchar

There are many scenarios in which you might want to add characters to the middle of a string, for example formatting a date string from ddMMyyyy to dd/MM/yyyy (standard format in the UK).

There are also quite a few ways to do this, you can use substring and concatenation methods, or in JavaScript you could use a split, splice & join.

In SQL there is a method to do this, you might think that it would be called something nice, like splice, but no! It's called STUFF! Granted, it does sound worse when you place an exclamation mark after it.

Anyway, this is how you would use the STUFF method using our example above.

DECLARE @strDate VARCHAR(8) = '16041980'

SELECT STUFF(STUFF(@strDate, 5, 0, '/'), 3, 0, '/') as [formattedDateString]

As you can see, we have used the STUFF method twice here, starting with the inner call, we add the '/' character that is nearest the end of our string, then with the outer call, we add the second from last '/' character.

It is important that we do it in this order, as we are modifying the length of the string with each call, & therefore the position of the characters after the one that we are adding.

The 5 and the 3 in the above snippet indicate the positions to insert the character, the 0's indicate how many characters at those positions we would like to overwrite, the others are self explanatory, however if you would like it, further reference can be found here on MSDN.

Monday, 10 October 2016

T-SQL: Casting Varchar to XML removing illegal characters

As I mentioned in an earlier post, we deal a lot with XML messages on ActiveMQ JMS queues going through our ESB.  For audit purposes most data that goes through the ESB is logged at some point, including these XML messages.

These XML messages have been stored, historically, in fields of type varchar, so if we want to use XPath to query the XML, we need to cast the varchar values to XML first.

Unfortunately, there are illegal characters in our XML, so we can't just CAST(... AS XML), we have to replace those characters first.

As I am a sharing kind of guy, here's a snippet to help others...

Configuring a proxy in Visual Studio 2015

Every now & then, I would get a little message pop-up in Visual Studio telling me that I needed to re-authenticate with the proxy, or proxy authentication required.

This isn't a massive problem, but it is a minor irritation, so to stop this happening, I found the devenv.exe.config file in C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\IDE and updated the <system.net> with default proxy settings, as below:

<system.net>
   <defaultProxy enabled="true" useDefaultCredentials="true">
   <proxy bypassonlocal="True" proxyaddress="http://webproxy.someDomain.com:8080"/>
   </defaultProxy>
   <settings>
      <ipv6 enabled="true"/>
   </settings>
</system.net>

Obviously, the proxyaddress has been modified above to something generic, so you will need to change that to whatever your proxy address is & specify the correct port number.

Saturday, 8 October 2016

First foray into the lair of the Mule...

Around a year ago I started a new job in the motor insurance industry, with a company that is part of the Lloyds Insurance syndicate who only do business through insurance brokers. These brokers send in details of new business, mid-term adjustmment, renewals & cancellations, claims.  Then this is complicated further by us providing breakdown cover too.

Now, you might think that this doesn't sound too complicated, give them a schema and ask them to send files to match that schema, or provide them with an API that they can hook into... nope!

Wednesday, 29 December 2010

Thursday, 25 November 2010

Oracle PL/SQL remove duplicates from a table

 If you have an oracle database table with duplicates in, and you want to remove said duplicates then you can use something like this: