Modern mainframe application development

  • Post category:DBAOTM
  • Reading time:6 mins read

In the previous DBAOTM article on DevOps I have introduced the traditional development process, which is often still used in a mainframe environment. In this post I will present a modern approach to development on the mainframe. Modern development processes for the mainframe Requirements for the development process have changed. Applications must be built faster and it must be possible to change applications more often and quicker without impacting the quality of the application. In other words, agile development is needed. The only way to address today business needs into modern agile development processes is to automate all build and deploy processes. A set of principles can then be derived for modern mainframe develops processes. All application artefacts are managed in the (or a) Source Code Management tool.The build processes for all artefact are automated, and can be coherently executed.A build can be deployed in any environment. A build has no environment or organization-specific dependencies.The deployment process for a build is fully automated. Including the fallback procedure. The deployment process is a coherent process for all application artefacts. These principles need to be supported by tools and processes that are (re)designed for these purposes. Of course this is not something specific to z/OS applications, but is true for any modern IT solution. But with the background I have sketched in the previous section, there is a legacy of development processes and tools to take into account and in many organizations this implies significant technical and organizational changes. The modern SCM for z/OS The modern SCM tool for z/OS needs to support all kinds of application artefacts. For the mainframe this means for one thing that not only traditional MVS-type artefacts must be supported, like COBOL programs, COPYBOOKS and JCL, but also Unix type artefacts like Unix scripts and configuration files in z/OS Unix directories. The tools and processes should allow for EBCDIC type artefacts to be created or the z/OS runtime environment, as well as ASCI, Unicode and binary artefacts. Modern SCM tools that can manage z/OS artefacts, are ISPW from Compuware, RTC form IBM, and a new option nowadays is Git, or GitHub. Build automation The modern DevOps process automates the creation of a build. The build process takes the required versions of the application artefacts from the source code management repository and creates a coherent package of these artefacts. This package, also called the build, is deployed in a (test) environment. The build could be deployed in any runtime environment, even outside your organizations. This principle not only enforces standardization of processes and infrastructure in your IT organization, it also allows any future deployments in yet unknown environments – for example in the Cloud. The automated build process itself should be callable through some generic API, so it can be integrated into other automated processes when needed. Build automation on z/OS can be accomplished with a number of tools. Some of these tools are able to handle the z/OS specific needs. IBM has two solutions: Rational build engine…

A job to submit a job

  • Post category:JCLUtilities
  • Reading time:1 min read

A simple trick that is often used in more complex JCL scripts, is to submit a job from a job. z/OS has a facility for this called the Internal Reader. The name Internal Reader stems from the old days when physical devices where used to read input in punch cards. These physical devices where called (external) readers. The Internal Reader is a logical device operating functionally, but virtually, like the physical device from the old days. Anyway, this is the JCL. //SUBJOB EXEC PGM=IEBGENER//SYSIN DD DUMMY//SYSPRINT DD DUMMY//SYSUT1 DD DSN=DATASET.NAME.JCL(NEXTJOB),DISP=SHR//SYSUT2 DD SYSOUT=(A,INTRDR) With this JCL you copy the JCL script in dataset DATASET.NAME.JCL(NEXTJOB) to the internal reader, which fundamentally submit the content as a job.

Programming languages for z/OS

  • Post category:DBAOTMProgramming
  • Reading time:6 mins read

In this post I will discuss the programming languages you find on z/OS, and what they are generally used for. COBOL The COBOL programming language was invented 60 years ago to make programs portable across different computers. The language is best usable for business programs (as opposed to scientific programs). COBOL is a language that must be compiled into executables, load modules. IDENTIFICATION DIVISION. PROGRAM-ID. COBPROG. ENVIRONMENT DIVISION. DATA DIVISION. PROCEDURE DIVISION. DISPLAY "HELLO WORLD". STOP RUN. PL/I PL/I was developed in the mid-1960s with the aim to create a programming language that could be used for business as well as scientific applications. Like COBOL, PL/I programs must be compiled into load modules. World: Procedure options(main); Put List( 'Hello world' ); End World; Assembler Assembler is still around. In the past business applications were developed using Assembler. Nowadays you should not do that anymore. But there are still a lot of legacy assembler programs around on the mainframe. In the old days, assembler was often used to implement tricks to achieve things that were not possible with the standard operating system, or other programming languages. This practice has created a problematic legacy of very technical programs in many mainframe application portfolios. The modern stance is that Assembler program should be regarded as severe legacy, because it is no longer maintainable and Assembler program are a risk for operating system and middleware updates. Furthermore, we find Assembler programs in modifications to the z/OS operating system and middleware. z/OS offers a number of points where you can customize the behavior of the operating system. These so-called exit-points oftentimes only have interfaces in Assembler. Like application programs in Assembler, z/OS exits in Assembler are a continuity risk. Not only because nobody knows how to program Assembler anymore, but even more so because these exit points make use of interfaces that IBM may (and wishes to) change at any point in the future. IBM is actively removing Assembler-based exit points and replacing these where needed with configuration parameters. The bottom line is that you should remove all home-grown Assembler programs from your z/OS installation. TEST0001 CSECT STM 14,12,12(13) BALR 12,0 USING *,12 ST 13,SAVE+4 LA 13,SAVE WTO 'HELLO WORLD!' L 13,SAVE+4 LM 14,12,12(13) BR 14 SAVE DS 18F END Java The language invented by a team from Sun in the 1990s with the goal to develop a language that could run on any device. Support for Java on the mainframe was introduced somewhere in the beginning of the 21st century. Java programs do not need to be compiled. They are interpreted by a special layer that must be installed in the runtime environment, called the Java Virtual Machine. The execution is (therefore) far more inefficient than COBOL and PL/I. So inefficient that running it on the mainframe would be very expensive (see section Understanding the cost of software on z/OS, MLC and OTC). To address this IBM invented the concept of zIIP specialty engines (see section Specialty engines), which makes running Java on the…

Copying Unix files to MVS Datasets

  • Post category:JCLUtilities
  • Reading time:1 min read

As mentioned in the previous post, another sample. This one copies a z/OS unix file to an MVS dataset. Also using OCOPY. //STEP5 EXEC PGM=IKJEFT01 //INUNIX DD PATH='/mydir/infile.txt',PATHOPTS=(ORDONLY) //OUTMVS DD DSN='TEST.MVS.OUTDS',DISP=SHR //* //SYSTSPRT DD SYSOUT=* //SYSTSIN DD * //SYSTSIN DD * OCOPY IND(INUNIX) OUTDD(OUTMVS) TEXT CONVERT(YES) PATHOPTS(USE) /*

Copying MVS Datasets to Unix files

  • Post category:JCLUtilities
  • Reading time:1 min read

Recently I had to get some people started with a few utilities. I thought to share this here. They will be in the next few posts for searchability reasons. There are more ways to Rome, as we say here, so please feel free share you variants in a comment. (I unfortunately need manually curate comments to filter out the spam which is even with this small site overwhelming.) //STEP1 EXEC PGM=IKJEFT01 //INMVS DD DSN=TEST.TRADMVS.DATA, // DISP=SHR //OUTFILE DD FILEDATA=TEXT, // PATHOPTS=(OWRONLY,OCREAT,OTRUNC), // PATHMODE=SIRWXU, // PATH='/mydir/myunixfile.txt’ //SYSTSPRT DD SYSOUT=* //SYSPRINT DD SYSOUT=*//SYSTSIN DD * OCOPY IND(INMVS) OUTDD(OUTFILE) //* Here's a link to the IBM documentation on OCOPY.

Execute an operator command via JCL

  • Post category:JCL
  • Reading time:1 min read

In my previous post I shared a way to execute operator command from a batch job using Rexx and SDSF. That is of course a bit cumbersome if you just want to fire off a fixed operator command. Therefore here the simplest way to execute an operator command: https://github.com/execpgm/execpgm-assets/blob/master/Tools/OperatorCommandJCL.txt //...jobcard //EXECCMD EXEC PGM=IEFBR14 // COMMAND 'D A,L'

The big free mainframe curriculum

  • Post category:EducationGeneral
  • Reading time:2 mins read

Learn mainframe, z/OS and Linux for Z on a shoestring. Let me know if you have any updates or additions to the list. Introduction Here's What Happens When an 18 Year Old Buys a Mainframe https://www.youtube.com/watch?v=45X4VP8CGtk&t=94s z/OS introductory video course http://www.redbooks.ibm.com/redbooks.nsf/redbookabstracts/crse0304.html?Open The ABCs of System Programming redbooks http://www.redbooks.ibm.com/abstracts/sg246981.html?Open IBM z/OS Basic Skills page in Knowledge Center.  https://www.ibm.com/support/knowledgecenter/en/zosbasics/com.ibm.zos.zbasics/lcmain.html Introduction to the new mainframe http://www.redbooks.ibm.com/abstracts/sg246366.html?Open RelevantZ site http://relevantz.ibmsystemsmag.com/ibm-systems-relevant-z IBM Z Youtube IBM Z YouTube channel Love mainframe https://lovemainframe.com/ Open source initiatives Zowe https://www.openmainframeproject.org/ Free training offers Cross-technology z/OS Introduction and Workshop http://dtsc.dfw.ibm.com/MVSDS/'HTTPD2.APPS.ZOSCLASS.SHTML(ZOSCLASS)' Master the mainframe: https://www.ibm.com/it-infrastructure/z/education/master-the-mainframe Free training at HPI https://open.hpi.de/courses/mainframes2018 Many tutorials on Mainframetechhelp https://www.mainframestechhelp.com/ Tutorialspoint on mainframe https://www.tutorialspoint.com/mainframe_tutorials.htm Mainframe Playground  https://mainframeplayground.neocities.org/ TSO/ISPF Introduction to TSO/ISPF https://www.tutorialbrain.com/mainframe/tso_ispf/ JCL Introduction to JCL https://www.tutorialbrain.com/mainframe/jcl_pgm_parameter/ JCL course https://www.tutorialspoint.com/jcl/jcl_job_statement.htm COBOL Introduction to COBOL https://www.tutorialbrain.com/mainframe/cobol_home/ Free COBOL course from CSIS http://www.csis.ul.ie/cobol/course/ Mainframe playground on COBOL https://mainframeplayground.neocities.org/COBOL.html Books (search for 2nd hand versions) Teach Yourself COBOL In 21 Days Murarch’s Mainframe COBOL CICS Introduction to CICS http://www.redbooks.ibm.com/abstracts/crse0303.html?Open Db2 for z/OS DB2 for z/OS: Data Sharing in a Nutshell Introduction to Db2 z/OS (for programmers) - https://www.tutorialbrain.com/mainframe/db2_tutorial/ MQ for z/OS MQ on z/os concepts https://www.ibm.com/support/knowledgecenter/en/SSFKSJ_8.0.0/com.ibm.mq.pro.doc/q003590_.htm http://share.confex.com/data/handout/share/131/Session_23611_handout_11867_0.pdf VSAM Introduction to VSAM https://www.tutorialbrain.com/mainframe/vsam_tutorial/ Assembler Assembler training https://punctiliousprogrammer.com/ibm-mainframe-assembler/ Developer topics IBM System z Tech Video’s IBM Z Systems tech zone Application Discovery ADDIApplication Delivery Foundation for z Systems ADFzzD&T - mainframe for hobiests on your Intel machine zD&T Access to real mainframe Unfortunately there is no Community mainframe yet. How cool would that be.  There is the emulator solution zD&T on which you can run z/OS legitimately (warning: quite cumbersome, slow and expensive.) IBM Z trials https://www.ibm.com/it-infrastructure/z/resources/trial Gives you 3 days access to a trial environment with scripted tutorials.. When you have a software development company, or if you are rich: Remote development programme on Dallas System z http://dtsc.dfw.ibm.com/MVSDS/'HTTPD2.ENROL.PUBLIC.SHTML(ZOSRDP)' (Will cost you something like $550 USD per month.)

Db2 SQL in batch

  • Post category:JCL
  • Reading time:1 min read

Again a simple solution for a common problem: how to run a Db2 query from a batch script. Here we use the utility DSNTEP2 that is provided for this purpose with the Db2 installation. In the STEPLIB, specify your names for Db2 runtime libraries. In the SYSTEM (xxxx) clause specify your Db2 subsystem. The SQL in the SYSIN label can be taken from in-stream, or from a dataset as below. //GO EXEC PGM=IKJEFT01,DYNAMNBR=20  //STEPLIB DD DSN=SYS2.SDSNEXIT,DISP=SHR  //        DD DSN=SYS2.SDSNLOAD,DISP=SHR      //SYSTSPRT DD SYSOUT=*   //SYSTSIN DD * DSN SYSTEM (xxxx)                                         RUN PROG (DSNTEP2) //SYSPRINT DD SYSOUT=* //SYSUDUMP DD SYSOUT=* //*SYSIN    DD DISP=SHR,DSN=YOURDSN.DB2.SQL(YOURSQL) OR //SYSIN DD * SELECT * FROM YOURTABLE /* //Dean

The definition of a user catalog

  • Post category:Catalog
  • Reading time:1 min read

Ok another short one: just a small JCL script with working example for the definition of a user catalog. This would accompany the example of the alias definition for a user catalog that can be found here. //DEFCAT   EXEC PGM=IDCAMS                                //SYSPRINT DD SYSOUT=*                                   //SYSIN    DD *                                        DEFINE UCAT (NAME(SYS1.USERCAT.PROD) VOLUME(DASD1B) -          CYL(6,1) ICFCAT  )          Enjoy. Pierre G.

How to copy the contents of a catalog: IDCAMS

  • Post category:Catalog
  • Reading time:1 min read

A very short one, but regularly asked by my mentees: how to copy the contents of a catalog? Just use IDCAMS' REPRO facility, like you would for a regular VSAM dataset //COPYCAT   EXEC PGM=IDCAMS                            //SYSPRINT DD SYSOUT=*                          //SYSIN    DD *                                       REPRO  INDATASET(CATALOG.MVSICFM.VD9ECAT) -                  OUTDATASET(SYS1.MSTRCTLG)    //Pierre G