java.lang.RuntimeException: Missing Application Host C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\SCPHost.exe

[Softwaremaker]

I have uploaded successfully the EventHubsWriter into Azure HDInsight Storm. However, when I clicked on Spout, it shows an exception at the SCPHost.

Is there something I am missing ? Thanks !

workernode0.wtmsdemostorm01.g8.internal.cloudapp.net 6703 java.lang.RuntimeException: Missing Application Host C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\SCPHost.exe at microsoft.scp.proxy.TaskHost.getWorkingDirectory(TaskHost.java:146) at microsoft.

java.lang.RuntimeException: Missing Application Host C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\SCPHost.exe at microsoft.scp.proxy.TaskHost.getWorkingDirectory(TaskHost.java:146) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.execute(TaskHost.java:184) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.checkAndExecute(TaskHost.java:176) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.ScpService.checkAndLaunchWorker(ScpService.java:93) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.storm.spout.ScpNetSpout.open(ScpNetSpout.java:74) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at backtype.storm.daemon.executor$fn5064$fn5079.invoke(executor.clj:542) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at backtype.storm.util$async_loop$fn__550.invoke(util.clj:463) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55] 2015-03-28 12:52:11 b.s.util [ERROR] Async loop died!

[Blackmist]

This error doesn't give us enough to work on. The main error implies that scphost.exe is missing, which is supposed to be preloaded on the HDInsight Storm clusters.

I would recommend:

1. Enable Remote Desktop for the cluster.
2. Connect to the cluster using Remote Desktop.
3. From the cluster, open Remote Desktop and then connect to Workernode0, since that's where this error is occurring.
4. Verify that c:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\scphost.exe actually exists.
5. Open Event Viewer.
6. Expand Applications and Services Logs, HDinsight, LogProvider, SCPNet, and select the Admin log.
7. Look through the entries in the log around the time this error occurred and see if they provide any more details.

[Shriyanshmit]

Hi, When i upload toplogy on Azure Storm Insight got issue related to SCPHost.exe missing . I copied from local machine and copy to RDP at location C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps. I upload two topology EventHubReader & EventHubWriter.

I follow article #4 but admin contains nothing.

Please let me know is there any other configuration required ? Error: java.lang.RuntimeException: Missing Application Host C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\SCPHost.exe at microsoft.scp.proxy.TaskHost.getWorkingDirectory(TaskHost.java:146) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.execute(TaskHost.java:184) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.checkAndExecute(TaskHost.java:176) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.ScpService.checkAndLaunchWorker(ScpService.java:93) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.storm.bolt.ScpNetBolt.prepare(ScpNetBolt.java:106) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at backtype.storm.daemon.executor$fn5132$fn5145.invoke(executor.clj:732) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at backtype.storm.util$async_loop$fn550.invoke(util.clj:463) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55] 2015-04-01 07:59:28 b.s.d.executor [ERROR] java.lang.RuntimeException: Missing Application Host C:\apps\dist\storm-0.9.3.2.2.1.0-2340\scp\apps\SCPHost.exe at microsoft.scp.proxy.TaskHost.getWorkingDirectory(TaskHost.java:146) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.execute(TaskHost.java:184) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.TaskHost.checkAndExecute(TaskHost.java:176) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.proxy.ScpService.checkAndLaunchWorker(ScpService.java:93) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at microsoft.scp.storm.bolt.ScpNetBolt.prepare(ScpNetBolt.java:106) ~[microsoft.scp-0.1.0-SNAPSHOT.jar:na] at backtype.storm.daemon.executor$fn5132$fn5145.invoke(executor.clj:732) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at backtype.storm.util$async_loop$fn550.invoke(util.clj:463) ~[storm-core-0.9.3.2.2.1.0-2340.jar:0.9.3.2.2.1.0-2340] at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]

Thanks

[Blackmist]

I understand why the error is occurring now, fix will be uploaded shortly.

Long-story short, the .gitignore was preventing some of the files/folders that contain SCP.NET binaries from being included in the repository. This doesn't cause an error when building or deploying, but you end up missing files from the deploy. I didn't notice it because, even though the files weren't checked into the repository, they were physically present on my local machine.

I'm double checking the fix now and will deploy shortly.

[jhashemi]

I'm still getting this.. I traced it down to SCPHost not being copied. I had to add it manually. I am running SDK Version ScpC Version: 1.0.5592.14588.

the cluster is using scp.version 0.9.4.124

https://www.dropbox.com/s/w0c7q7yo0arpunr/shot_150531_173104.png?dl=0

[Blackmist]

Can you verify that a "Microsoft.SCP.Net.SDK" folder exists under both the EventHubWriter and EventHubReader directories in your local copy? Contents should be:

• Build - folder containing Microsoft.SCP.Net.SDK.props and Microsoft.SCP.Net.SDK.targets
• Lib - folder containing Microsoft.SCPLogger.dll and .xml, Microsoft.SCPNet.dll and xml, and Thrift.dll and xml files.
• sdk - folder containing log4net dll and xml, Microsoft.Diagnostics.Tracing.EventSource dll and xml, Microsoft.SCPNet.dll.config, Newtonsoft.Json dll and xml, scp.log.config, SCPHost.exe and .config, SCPLogger.Log4net dll, EtWAppender.dll and EtwAppender.dll.config, SCPLogger_readme.txt, SCPPerfCounter.AzureCounter.dll, SCPPerfCounter.dll, and ZooKeeperNet.dll
• tools - folder containing install.ps1, Microsoft.SCPNet.dll, Newtonsoft.Json.dll, ScpC.exe, ScpC.exe.config, ScpWebApiClient.exe, ScpWebApiClient.exe.config.
• Microsoft.scp.net.sdk.0.9.4.283.nupkg

Those should be what are included currently in the repository.

Now, the SCP.Net bits were updated recently, and I had to delete and recreate my Storm cluster before projects created with the new bits worked. And this project was updated to work with the new bits. In theory, any new project you create using the Visual Studio Storm templates should be downloading the new 9.4.283 bits.

Anyway, I just pulled this repo down to a new folder (to be sure cached files weren't involved,) ran a build, set the properties for event hub and storage, then deployed to a new cluster and didn't get the error. Checking the above might reveal where the difference between your deployment and mine is occurring.

[jhashemi]

edit: I also forgot to mention that i tried it on 2 different cluster versions(3.1/3.2) on 2 different regions (east,east 2) This was a brand new topology i built within the last two days. All the files are there.

Folder PATH listing Volume serial number is C4CF-462E C:.	AbstractArticleInputBolt.cs	AbstractNServiceBusSBSubscriptionSpout.cs	app.config	ArticleCollectionStorageBolt.cs	ArticleParsingBolt.cs	ClassificationBolt.cs	ContextUtilities.cs	CreateSiteEntryBolt.cs	DbPediaBolt.cs	filetree.txt	GraphCreateSiteEntryBolt.cs	GraphKeywordUpdateBolt.cs	Hunspellx64.dll	Hunspellx86.dll	ImageAnalysisBolt.cs	KeywordAnalysisBolt.cs	LinkRocket.StormTopology.csproj	LinkRocket.StormTopology.csproj.user	LinkRocketNewSiteTopology.cs	LinkRocketNewSiteTopology.txt	LinkRocketTopology.Designer.cs	LinkRocketTopology.resx	LinkRocketTopologyGlobals.cs	LocalTest.cs	NamedEntityExtractionBolt.cs	NewSiteFoundMessage.cs	NewSiteFoundMessageSpout.cs	packages.config	Program.cs	ServiceBusNewSiteFoundMessageConverterBolt.cs	ServiceBusSubscriptionSpout.cs	SiteDownloadBolt.cs	SubmitConfig.xml	TrustFlowBolt.cs	YahooYQLBolt.cs

+---bin	---x64	---Debug		Accord.dll		Accord.Math.dll		Accord.Math.xml		Accord.xml		AForge.dll		AForge.Math.dll		AForge.Math.xml		AForge.xml		ArticleCollectionStorageBolt.txt		ArticleParsingBolt.txt		Autofac.dll		Autofac.Extras.NLog.dll		Autofac.xml		AutoMapper.dll		AutoMapper.Net4.dll		AutoMapper.Net4.pdb		AutoMapper.pdb		AutoMapper.xml		C5.dll		ClassificationBolt.txt		clf-learning-utils.dll		clf-semantic-html-cleaner.dll		Common.dll		Common.Logging.Core.dll		Common.Logging.Core.pdb		Common.Logging.Core.xml		Common.Logging.dll		Common.Logging.pdb		Common.Logging.xml		commons-beanutils-1.8.0.dll		commons-collections-3.2.1.dll		commons-logging-1.1.3.dll		CreateSiteEntryBolt.txt		CSharpTest.Net.BPlusTree.dll		CSharpTest.Net.BPlusTree.xml		CSharpTest.Net.Library.dll		CSharpTest.Net.Library.xml		CsQuery.dll		CsQuery.xml		CsvReader.dll		CsvReader.xml		Cudafy.NET.dll		Cudafy.NET.xml		DbPediaBolt.txt		dotNetRDF.dll		dotNetRDF.xml		Elasticsearch.Net.dll		Elasticsearch.Net.pdb		Elasticsearch.Net.xml		Esent.Collections.dll		Esent.Collections.pdb		Esent.Collections.xml		Esent.Interop.dll		Esent.Interop.pdb		Esent.Interop.xml		ExtractionExperimentTools.dll		ExtractionExperimentTools.xml		FSharp.Core.dll		FSharp.Core.xml		GoogleAnalyticsTracker.Core.dll		GraphCreateSiteEntryBolt.txt		GraphKeywordUpdateBolt.txt		HtmlAgilityPack.dll		HtmlAgilityPack.pdb		HtmlAgilityPack.xml		htmlparser-1.6.dll		Hunspellx64.dll		Hunspellx86.dll		ICSharpCode.SharpZipLib.dll		Iesi.Collections.dll		Iesi.Collections.xml		IKVM.AWT.WinForms.dll		IKVM.OpenJDK.Beans.dll		IKVM.OpenJDK.Charsets.dll		IKVM.OpenJDK.Cldrdata.dll		IKVM.OpenJDK.Corba.dll		IKVM.OpenJDK.Core.dll		IKVM.OpenJDK.Jdbc.dll		IKVM.OpenJDK.Localedata.dll		IKVM.OpenJDK.Management.dll		IKVM.OpenJDK.Media.dll		IKVM.OpenJDK.Misc.dll		IKVM.OpenJDK.Naming.dll		IKVM.OpenJDK.Nashorn.dll		IKVM.OpenJDK.Remoting.dll		IKVM.OpenJDK.Security.dll		IKVM.OpenJDK.SwingAWT.dll		IKVM.OpenJDK.Text.dll		IKVM.OpenJDK.Tools.dll		IKVM.OpenJDK.Util.dll		IKVM.OpenJDK.XML.API.dll		IKVM.OpenJDK.XML.Bind.dll		IKVM.OpenJDK.XML.Crypto.dll		IKVM.OpenJDK.XML.Parse.dll		IKVM.OpenJDK.XML.Transform.dll		IKVM.OpenJDK.XML.WebServices.dll		IKVM.OpenJDK.XML.XPath.dll		IKVM.Runtime.dll		IKVM.Runtime.JNI.dll		ImageAnalysisBolt.txt		Infer.Compiler.dll		Infer.Compiler.pdb		Infer.Compiler.xml		Infer.Runtime.dll		Infer.Runtime.pdb		Infer.Runtime.xml		Ionic.Zip.dll		Ionic.Zip.xml		Isg.Range.dll		jasper-compiler-jdt.dll		javax.json.dll		joda-time.dll		jollyday.dll		jxl.dll		jxl.pdb		KeywordAnalysisBolt.txt		LAIR.Collections.dll		LAIR.Collections.xml		LAIR.Extensions.dll		LAIR.Extensions.xml		LAIR.GraphViz.dll		LAIR.IO.dll		LAIR.IO.xml		LAIR.MachineLearning.dll		LAIR.MachineLearning.xml		LAIR.Misc.dll		LAIR.Misc.xml		LAIR.Morphology.dll		LAIR.Morphology.xml		LAIR.ResourceAPIs.NomBank.dll		LAIR.ResourceAPIs.PennBank.dll		LAIR.ResourceAPIs.WordNet.dll		LAIR.XML.dll		LAIR.XML.xml		Latino.dll		Latino.pdb		LemmaSharp.dll		LemmaSharpPrebuilt.dll		LemmaSharpPrebuiltCompact.dll		lingpipe-4.1.0.dll		lingpipe-4.1.0.pdb		LinkRocket.Common.dll		LinkRocket.Common.pdb		LinkRocket.CommonLibraries.dll		LinkRocket.CommonLibraries.pdb		LinkRocket.ContentAnalysis.dll		LinkRocket.ContentAnalysis.pdb		LinkRocket.Contracts.dll		LinkRocket.Contracts.pdb		LinkRocket.CrawlerServices.dll		LinkRocket.CrawlerServices.pdb		LinkRocket.Repositories.dll		LinkRocket.Repositories.pdb		LinkRocket.StormTopology.dll		LinkRocket.StormTopology.dll.config		LinkRocket.StormTopology.pdb		LinkRocket.StormTopology.vshost.exe		LinkRocket.StormTopology.vshost.exe.config		LinkRocket.UnsafeLibs.dll		LinkRocket.UnsafeLibs.pdb		LinkRocketNewSiteTopology.txt		log4j-1.2.16.dll		log4net.dll		log4net.xml		lucene-core-2.9.1.dll		Lucene.Net.Contrib.Memory.dll		Lucene.Net.Contrib.Memory.pdb		Lucene.Net.Contrib.Memory.xml		Lucene.Net.Contrib.Snowball.dll		Lucene.Net.Contrib.Snowball.pdb		Lucene.Net.Contrib.Snowball.xml		Lucene.Net.Contrib.SpellChecker.dll		Lucene.Net.Contrib.SpellChecker.pdb		Lucene.Net.Contrib.SpellChecker.xml		Lucene.Net.dll		Lucene.Net.pdb		Lucene.Net.xml		LZ4.dll		Lz4Net.dll		Lz4Net.pdb		Lz4Net.xml		Lzma#.dll		MathNet.Numerics.Data.Text.dll		MathNet.Numerics.Data.Text.xml		MathNet.Numerics.dll		MathNet.Numerics.xml		Microsoft.ApplicationServer.Caching.AzureClientHelper.dll		Microsoft.ApplicationServer.Caching.AzureCommon.dll		Microsoft.ApplicationServer.Caching.AzureCommon.xml		Microsoft.ApplicationServer.Caching.Client.dll		Microsoft.ApplicationServer.Caching.Client.xml		Microsoft.ApplicationServer.Caching.Core.dll		Microsoft.ApplicationServer.Caching.Core.xml		Microsoft.Azure.Documents.Client.dll		Microsoft.CSharp.dll		Microsoft.Data.Edm.dll		Microsoft.Data.Edm.xml		Microsoft.Data.OData.dll		Microsoft.Data.OData.xml		Microsoft.Data.Services.Client.dll		Microsoft.Data.Services.Client.xml		Microsoft.Diagnostics.Tracing.EventSource.dll		Microsoft.Diagnostics.Tracing.EventSource.xml		Microsoft.Dynamic.dll		Microsoft.Dynamic.xml		Microsoft.Experience.CloudFx.Extensions.dll		Microsoft.Experience.CloudFx.Extensions.pdb		Microsoft.Experience.CloudFx.Extensions.xml		Microsoft.Experience.CloudFx.Framework.dll		Microsoft.Experience.CloudFx.Framework.pdb		Microsoft.Experience.CloudFx.Framework.xml		Microsoft.Hadoop.Avro.dll		Microsoft.Hadoop.Avro.xml		Microsoft.Hadoop.Client.dll		Microsoft.Hadoop.Client.xml		Microsoft.Hadoop.WebClient.dll		Microsoft.HDInsight.Net.Http.Formatting.dll		Microsoft.HDInsight.Net.Http.Formatting.xml		Microsoft.Practices.EnterpriseLibrary.Common.dll		Microsoft.Practices.EnterpriseLibrary.Common.xml		Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.Caching.dll		Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.Caching.xml		Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.dll		Microsoft.Practices.EnterpriseLibrary.TransientFaultHandling.xml		Microsoft.Practices.EnterpriseLibrary.WindowsAzure.Configuration.dll		Microsoft.Practices.EnterpriseLibrary.WindowsAzure.Configuration.xml		Microsoft.Research.Naiad.dll		Microsoft.Research.Naiad.pdb		Microsoft.Research.Naiad.xml		Microsoft.SCPLogger.dll		Microsoft.SCPLogger.xml		Microsoft.SCPNet.dll		Microsoft.SCPNet.dll.config		Microsoft.SCPNet.xml		Microsoft.Scripting.dll		Microsoft.Scripting.Metadata.dll		Microsoft.Scripting.Metadata.xml		Microsoft.Scripting.xml		Microsoft.ServiceBus.dll		Microsoft.ServiceBus.xml		Microsoft.Ted.Wacel.Base.dll		Microsoft.Ted.Wacel.Cache.dll		Microsoft.Ted.Wacel.dll		Microsoft.Ted.Wacel.TableStorage.dll		Microsoft.Web.DistributedCache.dll		Microsoft.WindowsAzure.Configuration.dll		Microsoft.WindowsAzure.Configuration.xml		Microsoft.WindowsAzure.Management.HDInsight.Contracts.dll		Microsoft.WindowsAzure.Management.HDInsight.Contracts.xml		Microsoft.WindowsAzure.Management.HDInsight.dll		Microsoft.WindowsAzure.Management.HDInsight.Framework.Core.dll		Microsoft.WindowsAzure.Management.HDInsight.Framework.Core.xml		Microsoft.WindowsAzure.Management.HDInsight.Framework.dll		Microsoft.WindowsAzure.Management.HDInsight.Framework.Experimental.Threading.dll		Microsoft.WindowsAzure.Management.HDInsight.Framework.xml		Microsoft.WindowsAzure.Management.HDInsight.xml		Microsoft.WindowsAzure.ServiceRuntime.dll		Microsoft.WindowsAzure.Storage.dll		Microsoft.WindowsAzure.Storage.xml		Microsoft.WindowsFabric.Common.dll		Microsoft.WindowsFabric.Data.Common.dll		MsgPack.dll		MsgPack.xml		NamedEntityExtractionBolt.txt		NBoilerpipe.dll		NBoilerpipe.pdb		nekohtml-0.9.5.dll		Neo4jClient.dll		Neo4jClient.Extension.Attributes.dll		Neo4jClient.Extension.Attributes.pdb		Neo4jClient.pdb		Neo4jClient.xml		Nest.dll		Nest.pdb		Nest.xml		NewSiteFoundMessageSpout.txt		Newtonsoft.Json.dll		Newtonsoft.Json.xml		NHunspell.dll		NHunspell.pdb		NLog.dll		NLog.xml		nsb_log_2015-06-01_0.txt		NServiceBus.Azure.dll		NServiceBus.Azure.pdb		NServiceBus.Azure.xml		NServiceBus.Core.dll		NServiceBus.Core.pdb		NServiceBus.Core.xml		OAuth.dll		OAuth.pdb		OAuth.xml		org.apache.lucene.analysis.dll		org.apache.lucene.core.dll		org.apache.lucene.v2_3.6.0.dll		Pasternack.Hashing.dll		Pasternack.Hashing.xml		Pasternack.HTMLTools.dll		Pasternack.HTMLTools.xml		protobuf-net.dll		protobuf-net.pdb		protobuf-net.xml		QHALib.dll		QuickGraph.dll		QuickGraph.xml		ReliabilityPatterns.dll		ReliabilityPatterns.xml		reverb-latest.dll		scp.log.config		SCPHost.exe		SCPHost.exe.config		SCPLogger.Log4net.dll		SCPLogger.Log4net.EtwAppender.dll		SCPLogger.Log4net.EtwAppender.dll.config		SCPLogger_ReadMe.txt		SCPPerfCounter.AzureCounter.dll		SCPPerfCounter.dll		ScrapySharp.Core.dll		ScrapySharp.Core.pdb		ScrapySharp.Core.xml		ScrapySharp.dll		ScrapySharp.pdb		ServiceControl.Plugin.Nsb5.SagaAudit.dll		ServiceControl.Plugin.Nsb5.SagaAudit.pdb		ServiceControl.Plugin.Nsb5.SagaAudit.xml		ServiceStack.Common.dll		ServiceStack.Common.xml		ServiceStack.Interfaces.dll		ServiceStack.Logging.NLog.dll		ServiceStack.Redis.dll		ServiceStack.Redis.pdb		ServiceStack.Redis.xml		ServiceStack.Text.dll		ServiceStack.Text.xml		SiteDownloadBolt.txt		SizSelCsZzz.dll		SizSelCsZzz.pdb		slf4j-log4j12-1.6.1.dll		Smrf.NodeXL.Algorithms.dll		Smrf.NodeXL.Algorithms.xml		Smrf.NodeXL.Core.dll		Smrf.NodeXL.Core.xml		Smrf.NodeXL.Util.dll		Smrf.NodeXL.Util.xml		SnowMaker.dll		SocialSense.dll		SolrNet.dll		SolrNet.pdb		SolrNet.xml		stanford-ner.dll		System.Configuration.dll		System.Data.DataSetExtensions.dll		System.Data.dll		System.dll		System.Net.Http.dll		System.Net.Http.Formatting.dll		System.Net.Http.Formatting.xml		System.Net.Http.WebRequest.dll		System.Numerics.dll		System.Reactive.Core.dll		System.Reactive.Core.xml		System.Reactive.Interfaces.dll		System.Reactive.Interfaces.xml		System.Reactive.Linq.dll		System.Reactive.Linq.xml		System.Reactive.PlatformServices.dll		System.Reactive.PlatformServices.xml		System.Runtime.Serialization.dll		System.ServiceModel.dll		System.Spatial.dll		System.Spatial.xml		System.Threading.Tasks.Dataflow.dll		System.Threading.Tasks.Dataflow.xml		System.Xml.dll		System.Xml.Linq.dll		Thrift.dll		Thrift.xml		Tokenizer.dll		TokenProcessor.dll		trove-1.1-beta-5.dll		TrustFlowBolt.txt		Utility.dll		VDS.Common.dll		VDS.Common.pdb		VDS.Common.xml		WebDriver.dll		WebDriver.Support.dll		WebDriver.Support.xml		WebDriver.xml		weka.dll		xercesImpl.dll		xom.dll		YahooYQLBolt.txt		ZooKeeperNet.dll
+---ApplicationData
	---LinkRocket
	en_US.aff
	en_US.dic
	hyph_en_US.dic
	th_en_US_v2.dat
	th_en_US_v2.idx
+---de
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---dics
	bg.xml
	ca.xml
	cs.xml
	cy.xml
	da.xml
	de.xml
	el.xml
	en.xml
	eo.xml
	es.xml
	et.xml
	eu.xml
	fi.xml
	fr.xml
	ga.xml
	gl.xml
	he.xml
	hu.xml
	ia.xml
	id.xml
	is.xml
	it.xml
	lv.xml
	mi.xml
	ms.xml
	mt.xml
	nl.xml
	nn.xml
	pl.xml
	pt.xml
	ro.xml
	ru.xml
	sv.xml
	tl.xml
	tr.xml
	uk.xml
	yi.xml
+---es
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---fr
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---it
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---ja
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---KeywordExtraction
		KeywordExtractionApp.jar
	---gate
		gate-site.xml
		gate-user.xml
	---plugins
	+---ANNIE
			.ant-targets-build.xml
			build.xml
			creole.xml
		---resources
		+---BengaliNE
			+---grammar
				location.jape
				main.jape
				organisation.jape
				person.jape
			---tokeniser
			BengaliTokeniser.rules
		+---gazetteer
			abbreviations.lst
			adbc.lst
			airport.lst
			airports.lst
			cdg.lst
			charities.lst
			city.lst
			city_cap.lst
			city_uk.lst
			colours.lst
			company.lst
			company_cap.lst
			country.lst
			country_abbrev.lst
			country_adj.lst
			country_cap.lst
			currency_prefix.lst
			currency_unit.lst
			date.lst
			datespan.lst
			date_key.lst
			date_post.lst
			date_pre.lst
			date_unit.lst
			day.lst
			day_cap.lst
			department.lst
			determiner.lst
			facility.lst
			facility_key.lst
			facility_key_ext.lst
			festival.lst
			government.lst
			govern_key.lst
			greeting.lst
			hour.lst
			ident_prekey.lst
			jobtitles.lst
			lists.def
			loc_generalkey.lst
			loc_key.lst
			loc_prekey.lst
			loc_prekey_lower.lst
			loc_relig.lst
			mapping.def
			ministry.lst
			minutes.lst
			months.lst
			months_lower.lst
			mountain.lst
			newspapers.lst
			new_adj.lst
			new_cdg.lst
			nonspec_date.lst
			non_company.lst
			not_org.lst
			numbers.lst
			number_fold.lst
			ordinal.lst
			organization.lst
			organization_nouns.lst
			org_base.lst
			org_ending.lst
			org_key.lst
			org_key_cap.lst
			org_pre.lst
			org_spur.lst
			other_people.lst
			othorg_key.lst
			percent.lst
			person_ambig.lst
			person_ambig.old.lst
			person_ambig2.lst
			person_ambig_lower.lst
			person_ending.lst
			person_female.lst
			person_female_cap.lst
			person_female_lower.lst
			person_first.lst
			person_full.lst
			person_male.lst
			person_male_cap.lst
			person_male_lower.lst
			person_relig.lst
			person_sci.lst
			person_spur.lst
			phone_prefix.lst
			planet.lst
			province.lst
			province_aa.lst
			province_ab.lst
			racecourse.lst
			region.lst
			region_cap.lst
			region_uk.lst
			rivers.lst
			sports.lst
			spur.lst
			spur_ident.lst
			stop.lst
			street.lst
			surname_prefix.lst
			team.lst
			time.lst
			times.lst
			timespan.lst
			timex_pre.lst
			timezone.lst
			time_ampm.lst
			time_key.lst
			time_modifier.lst
			time_unit.lst
			title.lst
			title_female.lst
			title_lower.lst
			title_lowercase.lst
			title_male.lst
			title_mil.lst
			title_pol.lst
			tvcompany.lst
			water.lst
			year.lst
		+---heptag
			lexicon
			lexicon_all
			lexicon_cap
			lexicon_lower
			old_lexicon
			ruleset
			rules_cap
		+---NE
			address.jape
			clean.jape
			date.jape
			date_pre.jape
			email.jape
			final.jape
			first.jape
			firstname.jape
			gender.jape
			identifier.jape
			jobtitle.jape
			loc_context.jape
			main.jape
			name.jape
			name_context.jape
			name_post.jape
			number.jape
			org_context.jape
			reldate.jape
			unknown.jape
			url.jape
			url_pre.jape
		+---othomatcher
			acelists.def
			alias.lst
			alias_ace.lst
			cdg.lst
			chinese_alias.lst
			connnector.lst
			def_art.lst
			listsNM.def
			prepos.lst
			spur_match.lst
		+---regex-splitter
			external-split-patterns.txt
			internal-split-patterns.txt
			non-split-patterns.txt
		+---schema
			AddressSchema.xml
			CorefSchema.xml
			DateSchema.xml
			EmailSchema.xml
			EntityHeadSchema.xml
			EntityMentionSchema.xml
			EntitySchema.xml
			FacilitySchema.xml
			GpeSchema.xml
			IdentifierSchema.xml
			InternetSchema.xml
			LocationSchema.xml
			MoneySchema.xml
			OrganizationSchema.xml
			PercentSchema.xml
			PersonSchema.xml
			PhoneSchema.xml
			PosSchema.xml
			SentenceSchema.xml
			StreetSchema.xml
			SyntaxTreeNodeSchema.xml
			TokenSchema.xml
			UtteranceSchema.xml
		+---sentenceSplitter
			+---gazetteer
				abbreviations.lst
				lists.def
			---grammar
			cleanup.jape
			find-single-nl.jape
			find.jape
			main-single-nl.jape
			main.jape
			no-splits.jape
			prepare.jape
			removelookup.jape
			split.jape
		+---tokeniser
				AlternateTokeniser.rules
				DefaultTokeniser.rules
				postprocess.jape
			---chinesetokeniser
			bothlexu8.txt
			sforeign_u8.txt
			simplexu8.txt
			snotname_u8.txt
			snumbers_u8.txt
			ssurname_u8.txt
			tforeign_u8.txt
			tnotname_u8.txt
			tnumbers_u8.txt
			tradlexu8.txt
			tsurname_u8.txt
		---VP
		VerbGroups.jape
	+---KeyphraseAnalyser
			creole.xml
		+---FrequencyAnalyser
			build.properties
			build.xml
			creole_separate.xml
			FrequencyAnalyser.jar
			LICENSE
			README
		+---KeywordAnalyser
				build.properties
				build.xml
				creole_separate.xml
				KeywordAnalyser.jar
				LICENSE
			+---lib
				secondstring-20060615.jar
			---resources
			frequency_de.num.gz
			frequency_en.num.gz
			frequency_es.num.gz
			frequency_fi.num.gz
			frequency_fr.num.gz
			frequency_it.num.gz
			frequency_jp.num.gz
			frequency_pt.num.gz
			frequency_ru.num.gz
			frequency_zh.num.gz
			LICENSE.txt
		+---LanguageIdentification
				.ant-targets-build.xml
				.classpath
				.project
				build.properties
				build.xml
				creole_separate.xml
				GateLanguageIdentification.iml
				LanguageIdentification.jar
				LICENSE
				README
			---lib
			cngram.jar
		+---POSTagMapper
				build.properties
				build.xml
				creole_separate.xml
				LICENSE
				POSTagMapper.jar
				README
			+---resources
				tagsetmapping_de.lst
				tagsetmapping_en.lst
				tagsetmapping_fr.lst
			---tagsets
			french-tagset.html
			italian-tagset.txt
			itwac.tagset.txt
			spanish-tagset.txt
			stts_guide.ps
		+---SimpleNounChunking
				.ant-targets-build.xml
				build.properties
				build.xml
				creole_separate.xml
				LICENSE
				README
				SimpleNounChunking.jar
			---resources
			SimpleNounChunker.jape
		---StopwordMarker
			.ant-targets-build.xml
			build.properties
			build.xml
			creole_separate.xml
			LICENSE
			README
			StopwordMarker.jar
		---resources
		LICENSE.txt
		stopwords_ar.lst
		stopwords_bg.lst
		stopwords_cz.lst
		stopwords_de.lst
		stopwords_en.lst
		stopwords_es.lst
		stopwords_fi.lst
		stopwords_fr.lst
		stopwords_hu.lst
		stopwords_it.lst
		stopwords_pl.lst
		stopwords_pt.lst
		stopwords_ro.lst
		stopwords_ru.lst
		stopwords_sk.lst
	+---Tools
			creole.xml
		---resources
		---morph
		adj.dat
		adv.dat
		default.rul
		noun.dat
		verb.dat
	---TreeTagger
	build.xml
	creole.xml
	TreeTagger.jar
+---ko
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---Microsoft.SCP.Net.SDK
	---sdk
	SCPHost.exe.config
+---ru
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
+---x64
	lz4X64.dll
+---x86
	lz4X86.dll
+---zh-Hans
	Microsoft.Data.Edm.resources.dll
	Microsoft.Data.OData.resources.dll
	Microsoft.Data.Services.Client.resources.dll
	System.Spatial.resources.dll
---zh-Hant
Microsoft.Data.Edm.resources.dll
Microsoft.Data.OData.resources.dll
Microsoft.Data.Services.Client.resources.dll
System.Spatial.resources.dll

+---dics	bg.xml	ca.xml	cs.xml	cy.xml	da.xml	de.xml	el.xml	en.xml	eo.xml	es.xml	et.xml	eu.xml	fi.xml	fr.xml	ga.xml	gl.xml	he.xml	hu.xml	ia.xml	id.xml	is.xml	it.xml	lv.xml	mi.xml	ms.xml	mt.xml	nl.xml	nn.xml	pl.xml	pt.xml	ro.xml	ru.xml	sv.xml	tl.xml	tr.xml	uk.xml	yi.xml

+---KeywordExtraction		KeywordExtractionApp.jar
---gate
	gate-site.xml
	gate-user.xml
---plugins
+---ANNIE
		.ant-targets-build.xml
		build.xml
		creole.xml
	---resources
	+---BengaliNE
		+---grammar
			location.jape
			main.jape
			organisation.jape
			person.jape
		---tokeniser
		BengaliTokeniser.rules
	+---gazetteer
		abbreviations.lst
		adbc.lst
		airport.lst
		airports.lst
		cdg.lst
		charities.lst
		city.lst
		city_cap.lst
		city_uk.lst
		colours.lst
		company.lst
		company_cap.lst
		country.lst
		country_abbrev.lst
		country_adj.lst
		country_cap.lst
		currency_prefix.lst
		currency_unit.lst
		date.lst
		datespan.lst
		date_key.lst
		date_post.lst
		date_pre.lst
		date_unit.lst
		day.lst
		day_cap.lst
		department.lst
		determiner.lst
		facility.lst
		facility_key.lst
		facility_key_ext.lst
		festival.lst
		government.lst
		govern_key.lst
		greeting.lst
		hour.lst
		ident_prekey.lst
		jobtitles.lst
		lists.def
		loc_generalkey.lst
		loc_key.lst
		loc_prekey.lst
		loc_prekey_lower.lst
		loc_relig.lst
		mapping.def
		ministry.lst
		minutes.lst
		months.lst
		months_lower.lst
		mountain.lst
		newspapers.lst
		new_adj.lst
		new_cdg.lst
		nonspec_date.lst
		non_company.lst
		not_org.lst
		numbers.lst
		number_fold.lst
		ordinal.lst
		organization.lst
		organization_nouns.lst
		org_base.lst
		org_ending.lst
		org_key.lst
		org_key_cap.lst
		org_pre.lst
		org_spur.lst
		other_people.lst
		othorg_key.lst
		percent.lst
		person_ambig.lst
		person_ambig.old.lst
		person_ambig2.lst
		person_ambig_lower.lst
		person_ending.lst
		person_female.lst
		person_female_cap.lst
		person_female_lower.lst
		person_first.lst
		person_full.lst
		person_male.lst
		person_male_cap.lst
		person_male_lower.lst
		person_relig.lst
		person_sci.lst
		person_spur.lst
		phone_prefix.lst
		planet.lst
		province.lst
		province_aa.lst
		province_ab.lst
		racecourse.lst
		region.lst
		region_cap.lst
		region_uk.lst
		rivers.lst
		sports.lst
		spur.lst
		spur_ident.lst
		stop.lst
		street.lst
		surname_prefix.lst
		team.lst
		time.lst
		times.lst
		timespan.lst
		timex_pre.lst
		timezone.lst
		time_ampm.lst
		time_key.lst
		time_modifier.lst
		time_unit.lst
		title.lst
		title_female.lst
		title_lower.lst
		title_lowercase.lst
		title_male.lst
		title_mil.lst
		title_pol.lst
		tvcompany.lst
		water.lst
		year.lst
	+---heptag
		lexicon
		lexicon_all
		lexicon_cap
		lexicon_lower
		old_lexicon
		ruleset
		rules_cap
	+---NE
		address.jape
		clean.jape
		date.jape
		date_pre.jape
		email.jape
		final.jape
		first.jape
		firstname.jape
		gender.jape
		identifier.jape
		jobtitle.jape
		loc_context.jape
		main.jape
		name.jape
		name_context.jape
		name_post.jape
		number.jape
		org_context.jape
		reldate.jape
		unknown.jape
		url.jape
		url_pre.jape
	+---othomatcher
		acelists.def
		alias.lst
		alias_ace.lst
		cdg.lst
		chinese_alias.lst
		connnector.lst
		def_art.lst
		listsNM.def
		prepos.lst
		spur_match.lst
	+---regex-splitter
		external-split-patterns.txt
		internal-split-patterns.txt
		non-split-patterns.txt
	+---schema
		AddressSchema.xml
		CorefSchema.xml
		DateSchema.xml
		EmailSchema.xml
		EntityHeadSchema.xml
		EntityMentionSchema.xml
		EntitySchema.xml
		FacilitySchema.xml
		GpeSchema.xml
		IdentifierSchema.xml
		InternetSchema.xml
		LocationSchema.xml
		MoneySchema.xml
		OrganizationSchema.xml
		PercentSchema.xml
		PersonSchema.xml
		PhoneSchema.xml
		PosSchema.xml
		SentenceSchema.xml
		StreetSchema.xml
		SyntaxTreeNodeSchema.xml
		TokenSchema.xml
		UtteranceSchema.xml
	+---sentenceSplitter
		+---gazetteer
			abbreviations.lst
			lists.def
		---grammar
		cleanup.jape
		find-single-nl.jape
		find.jape
		main-single-nl.jape
		main.jape
		no-splits.jape
		prepare.jape
		removelookup.jape
		split.jape
	+---tokeniser
			AlternateTokeniser.rules
			DefaultTokeniser.rules
			postprocess.jape
		---chinesetokeniser
		bothlexu8.txt
		sforeign_u8.txt
		simplexu8.txt
		snotname_u8.txt
		snumbers_u8.txt
		ssurname_u8.txt
		tforeign_u8.txt
		tnotname_u8.txt
		tnumbers_u8.txt
		tradlexu8.txt
		tsurname_u8.txt
	---VP
	VerbGroups.jape
+---KeyphraseAnalyser
		creole.xml
	+---FrequencyAnalyser
		build.properties
		build.xml
		creole_separate.xml
		FrequencyAnalyser.jar
		LICENSE
		README
	+---KeywordAnalyser
			build.properties
			build.xml
			creole_separate.xml
			KeywordAnalyser.jar
			LICENSE
		+---lib
			secondstring-20060615.jar
		---resources
		frequency_de.num.gz
		frequency_en.num.gz
		frequency_es.num.gz
		frequency_fi.num.gz
		frequency_fr.num.gz
		frequency_it.num.gz
		frequency_jp.num.gz
		frequency_pt.num.gz
		frequency_ru.num.gz
		frequency_zh.num.gz
		LICENSE.txt
	+---LanguageIdentification
			.ant-targets-build.xml
			.classpath
			.project
			build.properties
			build.xml
			creole_separate.xml
			GateLanguageIdentification.iml
			LanguageIdentification.jar
			LICENSE
			README
		---lib
		cngram.jar
	+---POSTagMapper
			build.properties
			build.xml
			creole_separate.xml
			LICENSE
			POSTagMapper.jar
			README
		+---resources
			tagsetmapping_de.lst
			tagsetmapping_en.lst
			tagsetmapping_fr.lst
		---tagsets
		french-tagset.html
		italian-tagset.txt
		itwac.tagset.txt
		spanish-tagset.txt
		stts_guide.ps
	+---SimpleNounChunking
			.ant-targets-build.xml
			build.properties
			build.xml
			creole_separate.xml
			LICENSE
			README
			SimpleNounChunking.jar
		---resources
		SimpleNounChunker.jape
	---StopwordMarker
		.ant-targets-build.xml
		build.properties
		build.xml
		creole_separate.xml
		LICENSE
		README
		StopwordMarker.jar
	---resources
	LICENSE.txt
	stopwords_ar.lst
	stopwords_bg.lst
	stopwords_cz.lst
	stopwords_de.lst
	stopwords_en.lst
	stopwords_es.lst
	stopwords_fi.lst
	stopwords_fr.lst
	stopwords_hu.lst
	stopwords_it.lst
	stopwords_pl.lst
	stopwords_pt.lst
	stopwords_ro.lst
	stopwords_ru.lst
	stopwords_sk.lst
+---Tools
		creole.xml
	---resources
	---morph
	adj.dat
	adv.dat
	default.rul
	noun.dat
	verb.dat
---TreeTagger
build.xml
creole.xml
TreeTagger.jar

+---Microsoft.SCP.Net.SDK		Microsoft.SCP.Net.SDK.0.9.4.283.nupkg		Microsoft.SCP.Net.Test.SDK.0.9.4.224.nupkg		NuGet.exe		readme.txt		[Content_Types].xml
+---build
	Microsoft.SCP.Net.SDK.props
	Microsoft.SCP.Net.SDK.targets
	Microsoft.SCP.Net.Test.SDK.props
	Microsoft.SCP.Net.Test.SDK.targets
+---lib
	Microsoft.SCPLogger.dll
	Microsoft.SCPLogger.XML
	Microsoft.SCPNet.dll
	Microsoft.SCPNet.XML
	Thrift.dll
	Thrift.XML
+---sdk
	log4net.dll
	log4net.xml
	Microsoft.Diagnostics.Tracing.EventSource.dll
	Microsoft.Diagnostics.Tracing.EventSource.xml
	Microsoft.SCPLogger.dll
	Microsoft.SCPLogger.XML
	Microsoft.SCPNet.dll
	Microsoft.SCPNet.dll.config
	Microsoft.SCPNet.XML
	Newtonsoft.Json.dll
	Newtonsoft.Json.xml
	scp.log.config
	SCPHost.exe
	SCPHost.exe.config
	SCPLogger.Log4net.dll
	SCPLogger.Log4net.EtwAppender.dll
	SCPLogger.Log4net.EtwAppender.dll.config
	SCPLogger_ReadMe.txt
	SCPPerfCounter.AzureCounter.dll
	SCPPerfCounter.dll
	scpsdk.zip
	Thrift.dll
	Thrift.XML
	ZooKeeperNet.dll
---tools
Install.ps1
LinkRocket_StormToplogy.spec
LinkRocket_StormTopology.spec
LinkRocket_StormTopology.zip
ScpC.exe
ScpC.exe.config
ScpWebApiClient.exe
ScpWebApiClient.exe.config
TopologySubmit-20150531-070702.log
TopologySubmit-20150531-073035.log
TopologySubmit-20150531-081311.log
TopologySubmit-20150531-090555.log
TopologySubmit-20150531-094517.log
TopologySubmit-20150601-094334.log

+---obj	---x64	---Debug	DesignTimeResolveAssemblyReferencesInput.cache	LinkRocket.StormTopology.csproj.FileListAbsolute.txt	LinkRocket.StormTopology.csproj.GenerateResource.Cache	LinkRocket.StormTopology.csprojResolveAssemblyReference.cache	LinkRocket.StormTopology.dll	LinkRocket.StormTopology.LinkRocketTopology.resources	LinkRocket.StormTopology.pdb	TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs	TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs	TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs

+---Properties	AssemblyInfo.cs

+---x64	lz4X64.dll

---x86 lz4X86.dll

Also using either the SCPNetSubmission tool, or the SCPWebApi tool results in a failed deploy, however, logging in and using submit-spec works with the same package. C:\DEV\SourceControlled\LinkRocket\LinkRocket.StormTopology\Microsoft.SCP.Net.SDK\tools>ScpWebApiClient.exe submit -spec LinkRocket_StormTopology.spec -packagefile LinkRocket_StormTopology.zip ScpWebApiClient Version: 1.0.5595.28461 Submit topology to: "https://linkrocket.azurehdinsight.net/scpapi/api/SCPAPI/TopologySubmit" Topology spec file: "C:\DEV\SourceControlled\LinkRocket\LinkRocket.StormTopology\Microsoft.SCP.Net.SDK\tools\LinkRocket_StormTopology.spec" Topology package file: "C:\DEV\SourceControlled\LinkRocket\LinkRocket.StormTopology\Microsoft.SCP.Net.SDK\tools\LinkRocket_StormTopology.zip" Topology submitted failed with status code "NotFound".

C:\DEV\SourceControlled\LinkRocket\LinkRocket.StormTopology\Microsoft.SCP.Net.SDK\tools>

Log Result:

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">

Server Error

404 - File or directory not found.

The resource you are looking for might have been removed, had its name changed, or is temporarily unavailable.

[Blackmist]

At this point, all I can recommend is to open a case with Microsoft support and see if they can identify why it's not deploying the file correctly. I pinged a friend there earlier to see if he'd seen this previously, but he hadn't ran into this previously.

[ylashin]

Hi @jhashemi,

I had the same problem (404 while submitting a topology). As I am currently using much more recent nuget packages against latest Storm version in Azure, my explanation does not neccessarily apply to your case but still there is a chance. The root cause could be identified by Fiddler and it seems that ScpWebApiClient.exe accepts cluster URL without scpapi suffix

So the solution that worked with me is replacing API Url parameter used in the submit topology command: $scpApiUrl = New-Object Uri($clusterUri, "scpapi") with $scpApiUrl = New-Object Uri($clusterUri, "")